Aug 04 09:12:41 devstack cinder-volume[77662]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 04 09:12:41 devstack cinder-volume[77662]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 04 09:12:41 devstack cinder-volume[77662]: we strongly recommend against using it for new projects.
Aug 04 09:12:41 devstack cinder-volume[77662]: If you are already using Eventlet, we recommend migrating to a different
Aug 04 09:12:41 devstack cinder-volume[77662]: framework.  For more detail see
Aug 04 09:12:41 devstack cinder-volume[77662]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 04 09:12:41 devstack cinder-volume[77662]:   import eventlet  # noqa
Aug 04 09:12:43 devstack cinder-volume[77662]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 04 09:12:43 devstack cinder-volume[77662]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 04 09:12:43 devstack cinder-volume[77662]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 04 09:12:44 devstack cinder-volume[77662]: INFO dbcounter [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Registered counter for database cinder
Aug 04 09:12:44 devstack cinder-volume[77662]: DEBUG oslo_db.sqlalchemy.engines [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77662) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:12:45 devstack cinder-volume[77662]: DEBUG dbcounter [-] [77662] Writer thread running {{(pid=77662) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 04 09:12:45 devstack cinder-volume[77662]: INFO cinder.rpc [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 04 09:12:45 devstack cinder-volume[77662]: INFO cinder.rpc [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 04 09:12:45 devstack cinder-volume[77662]: DEBUG oslo_db.sqlalchemy.engines [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77662) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:12:45 devstack cinder-volume[77662]: INFO cinder.volume.manager [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Determined volume DB was empty at startup.
Aug 04 09:12:45 devstack cinder-volume[77662]: DEBUG cinder.volume.manager [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77662) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 04 09:12:45 devstack cinder-volume[77662]: INFO cinder.volume.manager [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Service not found for updating active_backend_id, assuming default for driver init.
Aug 04 09:12:45 devstack cinder-volume[77662]: WARNING stevedore.named [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 04 09:12:45 devstack cinder-volume[77662]: WARNING castellan.key_manager [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 04 09:12:45 devstack cinder-volume[77662]: WARNING cinder.keymgr.conf_key_mgr [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 04 09:12:45 devstack cinder-volume[77662]: DEBUG cinder.volume.drivers.lvm [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77662) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Aug 04 09:12:45 devstack cinder-volume[77662]: DEBUG oslo_concurrency.processutils [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:45 devstack cinder-volume[77662]: DEBUG oslo_concurrency.processutils [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.444s {{(pid=77662) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:45 devstack cinder-volume[77662]: DEBUG oslo_db.sqlalchemy.engines [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77662) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:12:45 devstack cinder-volume[77662]: INFO cinder.rpc [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Aug 04 09:12:45 devstack cinder-volume[77662]: INFO cinder.rpc [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Aug 04 09:12:45 devstack cinder-volume[77662]: WARNING stevedore.named [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 04 09:12:45 devstack cinder-volume[77662]: WARNING castellan.key_manager [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 04 09:12:45 devstack cinder-volume[77662]: INFO cinder.volume.manager [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_db.sqlalchemy.engines [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77662) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:12:46 devstack cinder-volume[77662]: INFO oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Starting 1 workers
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Started child 77816 {{(pid=77662) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Full set of CONF: {{(pid=77662) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] ******************************************************************************** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Configuration options gathered from: {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] ================================================================================ {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}}
Aug 04 09:12:46 devstack cinder-volume[77816]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] allow_availability_zone_fallback = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] allow_compression_on_image_upload = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] allowed_direct_url_schemes     = [] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] api_rate_limit                 = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] auth_strategy                  = keystone {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] az_cache_duration              = 3600 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_availability_zone      = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_host                   = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_name                   = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_stats_polling_interval = 60 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backup_api_class               = cinder.backup.api.API {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backup_name_template           = backup-%s {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backup_use_same_host           = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backup_use_temp_snapshot       = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] chap_password                  = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] chap_username                  =  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cinder_internal_tenant_project_id = 0f6a5682217645a1a6a0a7da0c2cdc46 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cinder_internal_tenant_user_id = e8f0641eadd444ec9fb3028f4b3a97c1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cloned_volume_same_az          = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cluster                        = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] compression_format             = gzip {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] config_dir                     = [] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] config_source                  = [] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] control_exchange               = openstack {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] debug                          = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] default_availability_zone      = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] default_group_type             = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] default_volume_type            = lvmdriver-1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] disk_geometry                  = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] driver_client_cert             = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] driver_client_cert_key         = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] driver_data_namespace          = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] driver_ssl_cert_path           = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] driver_ssl_cert_verify         = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] driver_use_ssl                 = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] enable_force_upload            = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] enable_new_services            = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] enable_unsupported_driver      = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] enforce_multipath_for_image_xfer = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] filter_function                = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance_api_insecure            = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance_api_servers             = ['http://192.168.122.129/image'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance_api_ssl_compression     = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance_ca_certificates_file    = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance_certfile                = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance_keyfile                 = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance_num_retries             = 3 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance_request_timeout         = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] goodness_function              = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] graceful_shutdown_timeout      = 5 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] group_api_class                = cinder.group.api.API {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] host                           = devstack {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] image_compress_on_upload       = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] image_conversion_address_space_limit = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] image_conversion_cpu_limit     = 60 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] image_conversion_disable       = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] image_upload_use_cinder_backend = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] image_upload_use_internal_tenant = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] image_volume_cache_enabled     = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] image_volume_cache_max_count   = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] image_volume_cache_max_size_gb = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] init_host_max_objects_retrieval = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] iscsi_target_flags             =  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] iscsi_write_cache              = on {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] iser_helper                    = tgtadm {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] iser_ip_address                = 192.168.122.129 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] iser_port                      = 3260 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] log_color                      = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] log_config_append              = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] log_dir                        = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] log_file                       = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] log_options                    = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] log_rotate_interval            = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] log_rotate_interval_type       = days {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] log_rotation_type              = none {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] max_age                        = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] max_logfile_count              = 30 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77816]: INFO cinder.volume.manager [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Starting volume driver LVMVolumeDriver (3.0.0)
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] max_logfile_size_mb            = 200 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] max_over_subscription_ratio    = 20.0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] message_reap_interval          = 86400 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] message_ttl                    = 2592000 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] migration_create_volume_timeout_secs = 300 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] monkey_patch                   = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] monkey_patch_modules           = [] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] my_ip                          = 192.168.122.129 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] no_snapshot_gb_quota           = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] num_iser_scan_tries            = 3 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] num_shell_tries                = 3 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] num_volume_device_scan_tries   = 3 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] nvmeof_conn_info_version       = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] nvmet_ns_id                    = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] nvmet_port_id                  = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] osapi_max_limit                = 1000 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] osapi_volume_ext_list          = [] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] osapi_volume_listen_port       = 8776 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] osapi_volume_use_ssl           = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] osapi_volume_workers           = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] per_volume_size_limit          = -1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] periodic_fuzzy_delay           = 60 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] periodic_interval              = 60 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] public_endpoint                = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] publish_errors                 = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] quota_backup_gigabytes         = 1000 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] quota_backups                  = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] quota_gigabytes                = 1000 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] quota_groups                   = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] quota_snapshots                = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] quota_volumes                  = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] rate_limit_burst               = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] rate_limit_except_level        = CRITICAL {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] rate_limit_interval            = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] reinit_driver_count            = 3 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] replication_device             = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] report_discard_supported       = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] report_interval                = 120 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] reservation_clean_interval     = 86400 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] reservation_expire             = 86400 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] reserved_image_namespaces      = [] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] reserved_percentage            = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] rpc_response_timeout           = 120 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] run_external_periodic_tasks    = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] scst_target_driver             = iscsi {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] scst_target_iqn_name           = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] service_down_time              = 720 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] shell_completion               = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] snapshot_name_template         = snapshot-%s {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] snapshot_same_host             = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] split_loggers                  = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] state_path                     = /opt/stack/data/cinder {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] storage_availability_zone      = nova {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] storage_protocol               = iSCSI {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] syslog_log_facility            = LOG_USER {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] target_helper                  = lioadm {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] target_ip_address              = 192.168.122.129 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] target_port                    = 3260 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] target_protocol                = iscsi {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] target_secondary_ip_addresses  = [] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] trace_flags                    = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] transport_url                  = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] until_refresh                  = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] use_chap_auth                  = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] use_default_quota_class        = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] use_journal                    = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] use_json                       = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] use_multipath_for_image_xfer   = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] use_stderr                     = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] use_syslog                     = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] verify_glance_signatures       = enabled {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volume_api_class               = cinder.volume.api.API {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volume_backend_name            = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volume_clear                   = zero {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volume_clear_ionice            = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volume_clear_size              = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volume_copy_bps_limit          = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volume_dd_blocksize            = 1M {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volume_name_template           = volume-%s {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volume_service_inithost_offload = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volume_usage_audit_period      = month {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] zoning_mode                    = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_concurrency.disable_process_locking = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.auth_section = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.auth_type   = password {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.auth_version = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.cache       = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.certfile    = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.include_service_catalog = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.insecure    = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.interface   = public {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.keyfile     = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_password =  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcache_username =  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.region_name = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.service_type = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.129/identity {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.backend                  = dogpile.cache.null {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.backend_argument         = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.backend_expiration_time  = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.config_prefix            = cache.oslo {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.debug_cache_backend      = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.enable_retry_client      = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.enable_socket_keepalive  = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.enabled                  = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.expiration_time          = 600 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.hashclient_retry_attempts = 2 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.memcache_dead_retry      = 300 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.memcache_sasl_enabled    = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.password                 = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.proxies                  = [] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.redis_db                 = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.redis_server             = localhost:6379 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.retry_attempts           = 2 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.retry_delay              = 0.0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.socket_keepalive_count   = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.socket_keepalive_idle    = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.socket_keepalive_interval = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.socket_timeout           = 1.0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.tls_allowed_ciphers      = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.tls_cafile               = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.tls_certfile             = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.tls_enabled              = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.tls_keyfile              = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cache.username                 = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] coordination.backend_url       = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.asyncio_connection    = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.asyncio_slave_connection = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.backend               = sqlalchemy {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.connection            = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.connection_debug      = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.connection_parameters =  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.connection_recycle_time = 3600 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.connection_trace      = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.db_inc_retry_interval = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.db_max_retries        = 20 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.db_max_retry_interval = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.db_retry_interval     = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.max_overflow          = 50 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.max_pool_size         = 5 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.max_retries           = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.mysql_wsrep_sync_wait = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.pool_timeout          = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.retry_interval        = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.slave_connection      = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.sqlite_synchronous    = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.synchronous_reader    = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] database.use_db_reconnect      = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler.connection_string     = messaging:// {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler.enabled               = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler.es_doc_type           = notification {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler.es_scroll_size        = 10000 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler.es_scroll_time        = 2m {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler.filter_error_trace    = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler.hmac_keys             = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler.sentinel_service_name = mymaster {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler.socket_timeout        = 0.1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler.trace_requests        = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler.trace_sqlalchemy      = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler_jaeger.process_tags   = {} {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler_jaeger.service_name_prefix = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] profiler_otlp.service_name_prefix = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_policy.enforce_new_defaults = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_policy.policy_default_rule = default {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] privsep_osbrick.group          = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] privsep_osbrick.helper_command = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] privsep_osbrick.user           = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cinder_sys_admin.group         = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cinder_sys_admin.helper_command = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] cinder_sys_admin.user          = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] service_user.auth_section      = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] service_user.auth_type         = password {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] service_user.cafile            = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] service_user.certfile          = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] service_user.collect_timing    = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] service_user.insecure          = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] service_user.keyfile           = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] service_user.send_service_user_token = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] service_user.split_loggers     = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] service_user.timeout           = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance.auth_section            = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance.auth_type               = password {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance.certfile                = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance.collect_timing          = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance.insecure                = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance.keyfile                 = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance.region_name             = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance.split_loggers           = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] glance.timeout                 = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.backend_availability_zone = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.chap_password = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.chap_username =  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.disk_geometry = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.driver_client_cert = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.driver_client_cert_key = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.driver_data_namespace = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.driver_use_ssl = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.extra_capabilities = {} {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.filter_function = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack sudo[77820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.goodness_function = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack sudo[77820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.iscsi_target_flags =  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.iscsi_write_cache = on {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.iser_ip_address = 192.168.122.129 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.iser_port     = 3260 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.lvm_share_target = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.lvm_type      = auto {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.num_shell_tries = 3 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.replication_device = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.report_discard_supported = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.reserved_percentage = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.target_helper = tgtadm {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.target_ip_address = 192.168.122.129 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.target_port   = 3260 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.target_protocol = iscsi {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.trace_flags   = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.unique_fqdn_network = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.use_chap_auth = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.volume_backend_name = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.volume_clear  = zero {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.volume_clear_ionice = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.volume_clear_size = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_reports.file_event_handler = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_reports.log_dir           = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.backend_host       = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.chap_password      = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.chap_username      = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.disk_geometry      = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.driver_client_cert = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.extra_capabilities = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.filter_function    = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.goodness_function  = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.iser_helper        = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.iser_ip_address    = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.iser_port          = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.lvm_share_target   = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.lvm_type           = auto {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.num_shell_tries    = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.replication_device = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.report_discard_supported = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.reserved_percentage = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.scst_target_driver = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.storage_protocol   = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.target_helper      = lioadm {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.target_ip_address  = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.target_port        = 3260 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.trace_flags        = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.use_chap_auth      = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.volume_clear       = zero {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.volume_clear_size  = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] lvmdriver-1.volumes_dir        = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_notifications.driver = [] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_notifications.retry = -1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] key_manager.fixed_key          = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.barbican_api_version  = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.barbican_endpoint     = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.barbican_endpoint_type = public {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.barbican_region_name  = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.cafile                = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.certfile              = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.collect_timing        = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.insecure              = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.keyfile               = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.number_of_retries     = 60 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.retry_delay           = 1 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.send_service_user_token = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.split_loggers         = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.timeout               = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.verify_ssl            = True {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican.verify_ssl_path       = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican_service_user.auth_section = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican_service_user.auth_type = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican_service_user.cafile   = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican_service_user.certfile = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican_service_user.collect_timing = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican_service_user.insecure = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican_service_user.keyfile  = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican_service_user.split_loggers = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] barbican_service_user.timeout  = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.approle_role_id          = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.approle_secret_id        = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.auth_method              = approle {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.auth_path                = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.kv_mountpoint            = secret {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.kv_path                  = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.kv_version               = 2 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.namespace                = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.root_token_id            = **** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.ssl_ca_crt_file          = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.timeout                  = 60.0 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.token_file               = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.token_role               = None {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.use_ssl                  = False {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:12:46 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] ******************************************************************************** {{(pid=77662) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}}
Aug 04 09:12:46 devstack sudo[77820]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.363s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:46 devstack sudo[77823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:12:46 devstack sudo[77823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:46 devstack sudo[77823]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.299s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:12:46 devstack cinder-volume[77816]: INFO cinder.brick.local_dev.lvm [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:46 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:46 devstack sudo[77954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 04 09:12:46 devstack sudo[77954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:47 devstack sudo[77954]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:47 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:47 devstack cinder-volume[77816]: DEBUG cinder.brick.local_dev.lvm [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77816) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Aug 04 09:12:47 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:47 devstack sudo[78050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:12:47 devstack sudo[78050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:47 devstack sudo[78050]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:47 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.506s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:47 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:47 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:47 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:47 devstack sudo[78234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:12:47 devstack sudo[78234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:48 devstack sudo[78234]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:48 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:48 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:48 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:48 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:48 devstack sudo[78337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Aug 04 09:12:48 devstack sudo[78337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:48 devstack sudo[78337]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:48 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.321s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:48 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:48 devstack sudo[78434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 04 09:12:48 devstack sudo[78434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:48 devstack sudo[78434]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:48 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:48 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:48 devstack sudo[78438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 04 09:12:48 devstack sudo[78438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:49 devstack sudo[78438]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:49 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.359s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:49 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:49 devstack sudo[78522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:12:49 devstack sudo[78522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:49 devstack sudo[78522]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:49 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:49 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:49 devstack sudo[78529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:12:49 devstack sudo[78529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:49 devstack sudo[78529]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:49 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:49 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:49 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:49 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:49 devstack sudo[78579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:12:49 devstack sudo[78579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:49 devstack sudo[78579]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:49 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:49 devstack cinder-volume[77816]: INFO cinder.volume.drivers.lvm [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Enabling LVM thin provisioning by default because a thin pool exists.
Aug 04 09:12:49 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:49 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:49 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:49 devstack sudo[78619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:12:49 devstack sudo[78619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:50 devstack sudo[78619]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:50 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:50 devstack cinder-volume[77816]: DEBUG cinder.volume.drivers.lvm [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Updating volume stats {{(pid=77816) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 04 09:12:50 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:50 devstack sudo[78622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 04 09:12:50 devstack sudo[78622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:50 devstack sudo[78622]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:50 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:50 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:50 devstack sudo[78637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:12:50 devstack sudo[78637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:50 devstack sudo[78637]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:50 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:50 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:50 devstack sudo[78640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:12:50 devstack sudo[78640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:50 devstack sudo[78640]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:50 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:50 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:50 devstack sudo[78643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:12:50 devstack sudo[78643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:51 devstack sudo[78643]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:51 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:51 devstack cinder-volume[77816]: INFO cinder.volume.driver [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Driver hasn't implemented _init_vendor_properties()
Aug 04 09:12:51 devstack cinder-volume[77816]: DEBUG cinder.volume.driver [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77816) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 04 09:12:51 devstack cinder-volume[77816]: DEBUG oslo_db.sqlalchemy.engines [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77816) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:12:51 devstack cinder-volume[77816]: DEBUG dbcounter [-] [77816] Writer thread running {{(pid=77816) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 04 09:12:51 devstack cinder-volume[77816]: DEBUG cinder.db.api [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Building query based on filter {{(pid=77816) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 04 09:12:51 devstack cinder-volume[77816]: DEBUG cinder.image.image_utils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77816) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 04 09:12:51 devstack cinder-volume[77816]: INFO cinder.keymgr.migration [None req-a61a6dbe-ae1c-4878-8844-66ce5f865644 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 04 09:12:51 devstack cinder-volume[77816]: DEBUG cinder.volume.drivers.lvm [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Updating volume stats {{(pid=77816) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 04 09:12:51 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:51 devstack sudo[78647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 04 09:12:51 devstack sudo[78647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:51 devstack sudo[78647]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:51 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:51 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:51 devstack sudo[78650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:12:51 devstack sudo[78650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:51 devstack sudo[78650]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:51 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:51 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:51 devstack sudo[78655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:12:51 devstack sudo[78655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:52 devstack sudo[78655]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:52 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:52 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:52 devstack sudo[78659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:12:52 devstack sudo[78659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:52 devstack sudo[78659]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:52 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:52 devstack cinder-volume[77816]: DEBUG cinder.manager [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Notifying Schedulers of capabilities ... {{(pid=77816) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:12:52 devstack cinder-volume[77816]: INFO cinder.volume.manager [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Driver initialization completed successfully.
Aug 04 09:12:52 devstack cinder-volume[77816]: INFO cinder.manager [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Initiating service 2 cleanup
Aug 04 09:12:52 devstack cinder-volume[77816]: INFO cinder.manager [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Service 2 cleanup completed.
Aug 04 09:12:52 devstack cinder-volume[77816]: DEBUG cinder.service [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Creating RPC server for service cinder-volume {{(pid=77816) start /opt/stack/cinder/cinder/service.py:231}}
Aug 04 09:12:52 devstack cinder-volume[77816]: DEBUG cinder.service [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77816) start /opt/stack/cinder/cinder/service.py:237}}
Aug 04 09:12:52 devstack cinder-volume[77816]: INFO cinder.volume.manager [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Aug 04 09:12:52 devstack cinder-volume[77816]: DEBUG cinder.volume.drivers.lvm [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Updating volume stats {{(pid=77816) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 04 09:12:52 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:52 devstack sudo[78663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 04 09:12:52 devstack sudo[78663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:52 devstack sudo[78663]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:52 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:52 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:52 devstack sudo[78667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:12:52 devstack sudo[78667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:53 devstack sudo[78667]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:53 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:53 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:53 devstack sudo[78670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:12:53 devstack sudo[78670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:53 devstack sudo[78670]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:53 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:53 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:12:53 devstack sudo[78673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:12:53 devstack sudo[78673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:12:53 devstack sudo[78673]: pam_unix(sudo:session): session closed for user root
Aug 04 09:12:53 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:12:53 devstack cinder-volume[77816]: INFO cinder.volume.manager [None req-6edafae8-21c5-4218-926d-65f37f2164fc None None] Driver post RPC initialization completed successfully.
Aug 04 09:12:54 devstack cinder-volume[77816]: DEBUG oslo_service.periodic_task [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running periodic task VolumeManager._thread_info {{(pid=77816) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:12:54 devstack cinder-volume[77816]: DEBUG cinder.volume.manager [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] thread count: 6 {{(pid=77816) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:12:54 devstack cinder-volume[77816]: DEBUG cinder.volume.manager [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] thread info: [<_MainThread(MainThread, started 127131930390656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127131818502208)>, <Thread(Thread-3 (stat_writer), started daemon 127131817432320)>, <Thread(Rabbit-heartbeat, started daemon 127131818020288)>, <Thread(Thread-5 (_runner), started daemon 127131818346112)>, <Thread(Thread-7 (_runner), started daemon 127131816357376)>] {{(pid=77816) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:12:56 devstack cinder-volume[77662]: DEBUG dbcounter [-] [77662] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77662) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:13:03 devstack cinder-volume[77816]: DEBUG dbcounter [-] [77816] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77816) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:13:03 devstack cinder-volume[77816]: DEBUG dbcounter [-] [77816] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=77816) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:13:54 devstack cinder-volume[77816]: DEBUG oslo_service.periodic_task [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77816) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:13:54 devstack cinder-volume[77816]: DEBUG cinder.volume.drivers.lvm [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Updating volume stats {{(pid=77816) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 04 09:13:54 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:13:54 devstack sudo[80681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 04 09:13:54 devstack sudo[80681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:13:55 devstack sudo[80681]: pam_unix(sudo:session): session closed for user root
Aug 04 09:13:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:13:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:13:55 devstack sudo[80684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:13:55 devstack sudo[80684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:13:55 devstack sudo[80684]: pam_unix(sudo:session): session closed for user root
Aug 04 09:13:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:13:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:13:55 devstack sudo[80705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:13:55 devstack sudo[80705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:13:55 devstack sudo[80705]: pam_unix(sudo:session): session closed for user root
Aug 04 09:13:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:13:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:13:55 devstack sudo[80708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:13:55 devstack sudo[80708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:13:55 devstack sudo[80708]: pam_unix(sudo:session): session closed for user root
Aug 04 09:13:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:13:55 devstack cinder-volume[77816]: DEBUG cinder.manager [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Notifying Schedulers of capabilities ... {{(pid=77816) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:13:55 devstack cinder-volume[77816]: DEBUG oslo_service.periodic_task [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running periodic task VolumeManager._thread_info {{(pid=77816) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:13:55 devstack cinder-volume[77816]: DEBUG cinder.volume.manager [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] thread count: 6 {{(pid=77816) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:13:55 devstack cinder-volume[77816]: DEBUG cinder.volume.manager [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] thread info: [<_MainThread(MainThread, started 127131930390656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127131818502208)>, <Thread(Thread-3 (stat_writer), started daemon 127131817432320)>, <Thread(Rabbit-heartbeat, started daemon 127131818020288)>, <Thread(Thread-5 (_runner), started daemon 127131818346112)>, <Thread(Thread-7 (_runner), started daemon 127131816357376)>] {{(pid=77816) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:14:54 devstack cinder-volume[77816]: DEBUG oslo_service.periodic_task [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77816) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:14:54 devstack cinder-volume[77816]: DEBUG cinder.volume.drivers.lvm [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Updating volume stats {{(pid=77816) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 04 09:14:54 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:14:54 devstack sudo[83988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 04 09:14:54 devstack sudo[83988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:14:55 devstack sudo[83988]: pam_unix(sudo:session): session closed for user root
Aug 04 09:14:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:14:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:14:55 devstack sudo[83998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:14:55 devstack sudo[83998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:14:55 devstack sudo[83998]: pam_unix(sudo:session): session closed for user root
Aug 04 09:14:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:14:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:14:55 devstack sudo[84001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:14:55 devstack sudo[84001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:14:55 devstack sudo[84001]: pam_unix(sudo:session): session closed for user root
Aug 04 09:14:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:14:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:14:55 devstack sudo[84043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:14:55 devstack sudo[84043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:14:55 devstack sudo[84043]: pam_unix(sudo:session): session closed for user root
Aug 04 09:14:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:14:55 devstack cinder-volume[77816]: DEBUG cinder.manager [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Notifying Schedulers of capabilities ... {{(pid=77816) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:14:55 devstack cinder-volume[77816]: DEBUG oslo_service.periodic_task [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running periodic task VolumeManager._thread_info {{(pid=77816) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:14:55 devstack cinder-volume[77816]: DEBUG cinder.volume.manager [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] thread count: 6 {{(pid=77816) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:14:55 devstack cinder-volume[77816]: DEBUG cinder.volume.manager [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] thread info: [<_MainThread(MainThread, started 127131930390656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127131818502208)>, <Thread(Thread-3 (stat_writer), started daemon 127131817432320)>, <Thread(Rabbit-heartbeat, started daemon 127131818020288)>, <Thread(Thread-5 (_runner), started daemon 127131818346112)>, <Thread(Thread-7 (_runner), started daemon 127131816357376)>] {{(pid=77816) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:15:03 devstack cinder-volume[77816]: DEBUG dbcounter [-] [77816] Writing DB stats cinder:SELECT=1 {{(pid=77816) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:15:03 devstack cinder-volume[77816]: DEBUG dbcounter [-] [77816] Writing DB stats cinder:UPDATE=1 {{(pid=77816) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:15:54 devstack cinder-volume[77816]: DEBUG oslo_service.periodic_task [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77816) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:15:54 devstack cinder-volume[77816]: DEBUG cinder.volume.drivers.lvm [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Updating volume stats {{(pid=77816) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 04 09:15:54 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:15:54 devstack sudo[86051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 04 09:15:54 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:15:55 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root
Aug 04 09:15:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:15:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:15:55 devstack sudo[86064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:15:55 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:15:55 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root
Aug 04 09:15:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:15:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:15:55 devstack sudo[86073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:15:55 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:15:55 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root
Aug 04 09:15:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:15:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:15:55 devstack sudo[86082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:15:55 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:15:55 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root
Aug 04 09:15:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:15:55 devstack cinder-volume[77816]: DEBUG cinder.manager [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Notifying Schedulers of capabilities ... {{(pid=77816) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:16:54 devstack cinder-volume[77816]: DEBUG oslo_service.periodic_task [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77816) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:16:54 devstack cinder-volume[77816]: DEBUG cinder.volume.drivers.lvm [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Updating volume stats {{(pid=77816) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 04 09:16:54 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:16:54 devstack sudo[87368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 04 09:16:54 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:16:55 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root
Aug 04 09:16:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:16:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:16:55 devstack sudo[87371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:16:55 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:16:55 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root
Aug 04 09:16:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:16:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:16:55 devstack sudo[87379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 04 09:16:55 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:16:55 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root
Aug 04 09:16:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:16:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:16:55 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 04 09:16:55 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:16:55 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Aug 04 09:16:55 devstack cinder-volume[77816]: DEBUG oslo_concurrency.processutils [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=77816) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:16:55 devstack cinder-volume[77816]: DEBUG cinder.manager [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Notifying Schedulers of capabilities ... {{(pid=77816) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:16:55 devstack cinder-volume[77816]: DEBUG oslo_service.periodic_task [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] Running periodic task VolumeManager._thread_info {{(pid=77816) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:16:55 devstack cinder-volume[77816]: DEBUG cinder.volume.manager [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] thread count: 6 {{(pid=77816) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:16:55 devstack cinder-volume[77816]: DEBUG cinder.volume.manager [None req-450edc2c-949f-4271-9d29-acc82105e24a None None] thread info: [<_MainThread(MainThread, started 127131930390656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127131818502208)>, <Thread(Thread-3 (stat_writer), started daemon 127131817432320)>, <Thread(Rabbit-heartbeat, started daemon 127131818020288)>, <Thread(Thread-5 (_runner), started daemon 127131818346112)>, <Thread(Thread-7 (_runner), started daemon 127131816357376)>] {{(pid=77816) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:17:03 devstack cinder-volume[77816]: DEBUG dbcounter [-] [77816] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77816) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:17:18 devstack cinder-volume[77662]: INFO oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Caught SIGTERM, stopping children
Aug 04 09:17:18 devstack cinder-volume[77662]: DEBUG oslo_concurrency.lockutils [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Acquiring lock "singleton_lock" {{(pid=77662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 04 09:17:18 devstack cinder-volume[77662]: DEBUG oslo_concurrency.lockutils [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Acquired lock "singleton_lock" {{(pid=77662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 04 09:17:18 devstack cinder-volume[77662]: DEBUG oslo_concurrency.lockutils [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Releasing lock "singleton_lock" {{(pid=77662) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 04 09:17:18 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Stop services. {{(pid=77662) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Aug 04 09:17:18 devstack cinder-volume[77662]: DEBUG oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Killing children. {{(pid=77662) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Aug 04 09:17:18 devstack cinder-volume[77662]: INFO oslo_service.backend._eventlet.service [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Waiting on 1 children to exit
Aug 04 09:17:23 devstack cinder-volume[77816]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Aug 04 09:17:23 devstack cinder-volume[87924]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 04 09:17:23 devstack cinder-volume[87924]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 04 09:17:23 devstack cinder-volume[87924]: we strongly recommend against using it for new projects.
Aug 04 09:17:23 devstack cinder-volume[87924]: If you are already using Eventlet, we recommend migrating to a different
Aug 04 09:17:23 devstack cinder-volume[87924]: framework.  For more detail see
Aug 04 09:17:23 devstack cinder-volume[87924]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 04 09:17:23 devstack cinder-volume[87924]:   import eventlet  # noqa
Aug 04 09:17:25 devstack cinder-volume[87924]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 04 09:17:25 devstack cinder-volume[87924]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 04 09:17:25 devstack cinder-volume[87924]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 04 09:17:26 devstack cinder-volume[87924]: INFO dbcounter [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Registered counter for database cinder
Aug 04 09:17:26 devstack cinder-volume[87924]: DEBUG oslo_db.sqlalchemy.engines [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:17:26 devstack cinder-volume[87924]: DEBUG dbcounter [-] [87924] Writer thread running {{(pid=87924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 04 09:17:26 devstack cinder-volume[87924]: INFO cinder.rpc [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 04 09:17:26 devstack cinder-volume[87924]: INFO cinder.rpc [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 04 09:17:26 devstack cinder-volume[87924]: DEBUG oslo_db.sqlalchemy.engines [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:17:26 devstack cinder-volume[87924]: INFO cinder.volume.manager [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Determined volume DB was empty at startup.
Aug 04 09:17:26 devstack cinder-volume[87924]: DEBUG cinder.volume.manager [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87924) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 04 09:17:26 devstack cinder-volume[87924]: INFO cinder.volume.manager [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Service not found for updating active_backend_id, assuming default for driver init.
Aug 04 09:17:26 devstack cinder-volume[87924]: WARNING stevedore.named [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 04 09:17:26 devstack cinder-volume[87924]: WARNING castellan.key_manager [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 04 09:17:26 devstack cinder-volume[87924]: WARNING cinder.keymgr.conf_key_mgr [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 04 09:17:27 devstack cinder-volume[87924]: INFO cinder.volume.manager [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_db.sqlalchemy.engines [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:17:27 devstack cinder-volume[87924]: INFO oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Starting 1 workers
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Started child 88178 {{(pid=87924) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Full set of CONF: {{(pid=87924) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] ******************************************************************************** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Configuration options gathered from: {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}}
Aug 04 09:17:27 devstack cinder-volume[88178]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] ================================================================================ {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] allow_availability_zone_fallback = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] allow_compression_on_image_upload = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] allowed_direct_url_schemes     = [] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] api_rate_limit                 = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] auth_strategy                  = keystone {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_availability_zone      = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_host                   = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_name                   = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_stats_polling_interval = 60 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backup_api_class               = cinder.backup.api.API {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backup_name_template           = backup-%s {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backup_use_same_host           = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backup_use_temp_snapshot       = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] chap_password                  = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] chap_username                  =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cinder_internal_tenant_project_id = 0f6a5682217645a1a6a0a7da0c2cdc46 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cinder_internal_tenant_user_id = e8f0641eadd444ec9fb3028f4b3a97c1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cluster                        = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] compression_format             = gzip {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] compute_api_class              = cinder.compute.nova.API {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] config_dir                     = [] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] config_source                  = [] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] control_exchange               = openstack {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] debug                          = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] default_availability_zone      = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] default_group_type             = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] default_volume_type            = QuobyteHD {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] disk_geometry                  = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] driver_client_cert             = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] driver_client_cert_key         = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] driver_data_namespace          = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] driver_ssl_cert_path           = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] driver_ssl_cert_verify         = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] driver_use_ssl                 = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] enable_new_services            = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] enable_unsupported_driver      = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] enabled_backends               = ['QuobyteHD'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] enforce_multipath_for_image_xfer = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] filter_function                = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance_api_insecure            = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance_api_servers             = ['http://192.168.122.129/image'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance_api_ssl_compression     = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance_ca_certificates_file    = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance_catalog_info            = image:glance:publicURL {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance_certfile                = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance_keyfile                 = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance_num_retries             = 3 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance_request_timeout         = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] goodness_function              = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] graceful_shutdown_timeout      = 5 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] group_api_class                = cinder.group.api.API {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] host                           = devstack {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] image_compress_on_upload       = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] image_conversion_address_space_limit = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] image_conversion_cpu_limit     = 60 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] image_conversion_disable       = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] image_upload_use_cinder_backend = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] image_upload_use_internal_tenant = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] image_volume_cache_enabled     = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] image_volume_cache_max_count   = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] image_volume_cache_max_size_gb = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] init_host_max_objects_retrieval = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] instance_format                = [instance: %(uuid)s]  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] iscsi_target_flags             =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] iscsi_write_cache              = on {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] iser_helper                    = tgtadm {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] iser_ip_address                = 192.168.122.129 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] iser_port                      = 3260 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] log_color                      = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] log_config_append              = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] log_dir                        = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] log_file                       = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] log_options                    = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] log_rotate_interval            = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] log_rotate_interval_type       = days {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] log_rotation_type              = none {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[88178]: INFO cinder.volume.manager [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Starting volume driver QuobyteDriver (1.1.14)
Aug 04 09:17:27 devstack cinder-volume[88178]: DEBUG cinder.volume.drivers.remotefs [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88178) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] max_age                        = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] max_logfile_count              = 30 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] max_logfile_size_mb            = 200 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] max_over_subscription_ratio    = 20.0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] message_reap_interval          = 86400 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] message_ttl                    = 2592000 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] migration_create_volume_timeout_secs = 300 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] monkey_patch                   = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] monkey_patch_modules           = [] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] my_ip                          = 192.168.122.129 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] no_snapshot_gb_quota           = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] num_iser_scan_tries            = 3 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] num_shell_tries                = 3 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] num_volume_device_scan_tries   = 3 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] nvmeof_conn_info_version       = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] nvmet_ns_id                    = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] nvmet_port_id                  = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] osapi_max_limit                = 1000 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] osapi_volume_ext_list          = [] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] osapi_volume_listen_port       = 8776 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] osapi_volume_use_ssl           = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] osapi_volume_workers           = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] per_volume_size_limit          = -1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] periodic_fuzzy_delay           = 60 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] periodic_interval              = 60 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] public_endpoint                = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] publish_errors                 = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] quota_backup_gigabytes         = 1000 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] quota_backups                  = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] quota_gigabytes                = 1000 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] quota_groups                   = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] quota_snapshots                = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] quota_volumes                  = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] rate_limit_burst               = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] rate_limit_except_level        = CRITICAL {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] rate_limit_interval            = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] reinit_driver_count            = 3 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] replication_device             = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] report_discard_supported       = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] report_interval                = 120 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] reservation_clean_interval     = 86400 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] reservation_expire             = 86400 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] reserved_image_namespaces      = [] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] reserved_percentage            = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] rpc_response_timeout           = 120 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] run_external_periodic_tasks    = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] scst_target_driver             = iscsi {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] scst_target_iqn_name           = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] service_down_time              = 720 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] shell_completion               = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] snapshot_name_template         = snapshot-%s {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] split_loggers                  = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] state_path                     = /opt/stack/data/cinder {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] storage_availability_zone      = nova {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] storage_protocol               = iSCSI {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] syslog_log_facility            = LOG_USER {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] target_helper                  = lioadm {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] target_ip_address              = 192.168.122.129 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] target_port                    = 3260 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] target_protocol                = iscsi {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] target_secondary_ip_addresses  = [] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] trace_flags                    = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] transport_url                  = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] until_refresh                  = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] use_chap_auth                  = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] use_default_quota_class        = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] use_journal                    = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] use_json                       = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] use_multipath_for_image_xfer   = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] use_stderr                     = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] use_syslog                     = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] verify_glance_signatures       = enabled {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volume_api_class               = cinder.volume.api.API {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volume_backend_name            = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volume_clear                   = zero {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volume_clear_ionice            = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volume_clear_size              = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volume_copy_bps_limit          = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volume_dd_blocksize            = 1M {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volume_name_template           = volume-%s {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volume_service_inithost_offload = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volume_usage_audit_period      = month {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] zoning_mode                    = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_concurrency.disable_process_locking = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.auth_section = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.auth_type   = password {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.auth_version = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.cache       = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.certfile    = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.delay_auth_decision = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.http_connect_timeout = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.include_service_catalog = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.insecure    = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.interface   = public {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.keyfile     = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_password =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcache_username =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.region_name = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.service_token_roles_required = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.service_type = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.token_cache_time = 300 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.129/identity {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.backend                  = dogpile.cache.null {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.backend_argument         = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.backend_expiration_time  = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.config_prefix            = cache.oslo {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.debug_cache_backend      = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.enable_retry_client      = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.enable_socket_keepalive  = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.enabled                  = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.expiration_time          = 600 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.hashclient_retry_attempts = 2 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.memcache_dead_retry      = 300 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[88178]: DEBUG cinder.volume.drivers.quobyte [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88178) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Aug 04 09:17:27 devstack cinder-volume[88178]: WARNING cinder.volume.drivers.quobyte [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Aug 04 09:17:27 devstack cinder-volume[88178]: WARNING cinder.volume.drivers.quobyte [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.memcache_pool_maxsize    = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.memcache_sasl_enabled    = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.password                 = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.proxies                  = [] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.redis_db                 = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.redis_sentinel_service_name = mymaster {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.redis_server             = localhost:6379 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.retry_attempts           = 2 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.retry_delay              = 0.0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.socket_keepalive_count   = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.socket_keepalive_idle    = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[88178]: DEBUG oslo_concurrency.processutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Running cmd (subprocess): mount.quobyte {{(pid=88178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.socket_keepalive_interval = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.socket_timeout           = 1.0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.tls_allowed_ciphers      = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.tls_cafile               = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.tls_certfile             = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.tls_enabled              = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.tls_keyfile              = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cache.username                 = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] coordination.backend_url       = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.asyncio_connection    = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.asyncio_slave_connection = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.backend               = sqlalchemy {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.connection            = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.connection_debug      = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.connection_parameters =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.connection_recycle_time = 3600 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.connection_trace      = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.db_inc_retry_interval = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.db_max_retries        = 20 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.db_max_retry_interval = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.db_retry_interval     = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.max_overflow          = 50 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.max_pool_size         = 5 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.max_retries           = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.mysql_wsrep_sync_wait = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.pool_timeout          = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.retry_interval        = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.slave_connection      = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.sqlite_synchronous    = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.synchronous_reader    = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] database.use_db_reconnect      = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler.connection_string     = messaging:// {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler.enabled               = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler.es_doc_type           = notification {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler.es_scroll_size        = 10000 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler.es_scroll_time        = 2m {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler.filter_error_trace    = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler.hmac_keys             = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler.sentinel_service_name = mymaster {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler.socket_timeout        = 0.1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler.trace_requests        = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler.trace_sqlalchemy      = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler_jaeger.process_tags   = {} {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler_jaeger.service_name_prefix = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] profiler_otlp.service_name_prefix = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_policy.enforce_new_defaults = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_policy.policy_default_rule = default {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_policy.policy_file        = policy.yaml {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] privsep_osbrick.group          = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] privsep_osbrick.helper_command = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] privsep_osbrick.user           = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cinder_sys_admin.group         = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cinder_sys_admin.helper_command = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] cinder_sys_admin.user          = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] service_user.auth_section      = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] service_user.auth_type         = password {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] service_user.cafile            = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] service_user.certfile          = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] service_user.collect_timing    = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] service_user.insecure          = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] service_user.keyfile           = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] service_user.send_service_user_token = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] service_user.split_loggers     = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] service_user.timeout           = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance.auth_section            = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance.auth_type               = password {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance.certfile                = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance.collect_timing          = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance.insecure                = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance.keyfile                 = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance.region_name             = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance.split_loggers           = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] glance.timeout                 = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.backend_availability_zone = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.chap_password = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.chap_username =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.disk_geometry = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.driver_client_cert = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.driver_client_cert_key = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.driver_data_namespace = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.driver_use_ssl = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.enable_unsupported_driver = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.extra_capabilities = {} {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.filter_function = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.goodness_function = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.iscsi_target_flags =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.iscsi_write_cache = on {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.iser_helper   = tgtadm {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.iser_ip_address = 192.168.122.129 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.iser_port     = 3260 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nas_host      =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nas_login     = admin {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nas_mount_options = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nas_password  = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nas_private_key =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nas_share_path =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.num_shell_tries = 3 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.nvmet_port_id = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.quobyte_client_cfg = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.quobyte_volume_url = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.replication_device = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.report_discard_supported = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.reserved_percentage = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.scst_target_driver = iscsi {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.scst_target_iqn_name = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.storage_protocol = iSCSI {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.target_helper = tgtadm {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.target_ip_address = 192.168.122.129 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.target_port   = 3260 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack quobyte-client[88179]: Reading configuration file: /etc/quobyte/client.cfg
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.target_protocol = iscsi {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.trace_flags   = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack quobyte-client[88179]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.unique_fqdn_network = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.use_chap_auth = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[88178]: DEBUG oslo_concurrency.processutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] CMD "mount.quobyte" returned: 1 in 0.119s {{(pid=88178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[88178]: DEBUG oslo_concurrency.lockutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88178) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:17:27 devstack cinder-volume[88178]: DEBUG oslo_concurrency.lockutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88178) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:17:27 devstack cinder-volume[88178]: DEBUG cinder.volume.drivers.quobyte [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88178) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.volume_backend_name = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[88178]: INFO cinder.volume.drivers.quobyte [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 ...
Aug 04 09:17:27 devstack cinder-volume[88178]: DEBUG oslo_concurrency.processutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f -c /etc/quobyte/client-cinder.cfg {{(pid=88178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.volume_clear  = zero {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.volume_clear_ionice = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.volume_clear_size = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_reports.file_event_handler = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_reports.log_dir           = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.backend_availability_zone = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.backend_host         = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.chap_password        = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.chap_username        = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.chiscsi_conf         = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.disk_geometry        = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.driver_client_cert   = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.driver_client_cert_key = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.driver_data_namespace = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.driver_use_ssl       = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack sudo[88180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f -c /etc/quobyte/client-cinder.cfg
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.extra_capabilities   = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.filter_function      = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.goodness_function    = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.iser_helper          = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.iser_ip_address      = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.iser_port            = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.iser_target_prefix   = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nas_host             = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nas_login            = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nas_mount_options    = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nas_password         = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nas_private_key      = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nas_share_path       = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nas_ssh_port         = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.num_shell_tries      = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.nvmet_port_id        = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.replication_device   = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.report_discard_supported = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.reserved_percentage  = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.scst_target_driver   = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.storage_protocol     = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.target_helper        = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.target_ip_address    = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.target_port          = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.target_prefix        = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.target_protocol      = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.trace_flags          = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.use_chap_auth        = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.volume_clear         = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.volume_clear_size    = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] QuobyteHD.volumes_dir          = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.ssl      = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_notifications.driver = [] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_notifications.retry = -1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] oslo_messaging_notifications.transport_url = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] key_manager.fixed_key          = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.barbican_api_version  = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.barbican_endpoint     = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.barbican_endpoint_type = public {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.barbican_region_name  = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.cafile                = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.certfile              = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.collect_timing        = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.insecure              = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.keyfile               = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.number_of_retries     = 60 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[77816]: DEBUG oslo_concurrency.lockutils [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Acquiring lock "singleton_lock" {{(pid=77816) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 04 09:17:27 devstack cinder-volume[77816]: DEBUG oslo_concurrency.lockutils [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Acquired lock "singleton_lock" {{(pid=77816) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 04 09:17:27 devstack cinder-volume[77816]: DEBUG oslo_concurrency.lockutils [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Releasing lock "singleton_lock" {{(pid=77816) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.retry_delay           = 1 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.send_service_user_token = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.split_loggers         = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.timeout               = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.verify_ssl            = True {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican.verify_ssl_path       = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican_service_user.auth_section = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican_service_user.auth_type = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican_service_user.cafile   = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican_service_user.certfile = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican_service_user.collect_timing = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican_service_user.insecure = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican_service_user.keyfile  = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican_service_user.split_loggers = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] barbican_service_user.timeout  = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.approle_role_id          = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.approle_secret_id        = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.auth_method              = approle {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.auth_path                = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.kv_mountpoint            = secret {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.kv_path                  = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.kv_version               = 2 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.namespace                = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.root_token_id            = **** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.ssl_ca_crt_file          = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.timeout                  = 60.0 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.token_file               = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.token_role               = None {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.use_ssl                  = False {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:27 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] ******************************************************************************** {{(pid=87924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}}
Aug 04 09:17:27 devstack cinder-volume[77816]: WARNING amqp [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 04 09:17:27 devstack cinder-volume[77816]: WARNING amqp [None req-5bb5d36e-85ff-430b-b47d-ecf6da8beef1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 04 09:17:27 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root
Aug 04 09:17:27 devstack cinder-volume[88178]: DEBUG oslo_concurrency.processutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.506s {{(pid=88178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:17:27 devstack cinder-volume[88178]: INFO cinder.volume.drivers.quobyte [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 succeeded
Aug 04 09:17:27 devstack cinder-volume[88178]: DEBUG cinder.volume.drivers.quobyte [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88178) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:17:27 devstack cinder-volume[88178]: DEBUG oslo_concurrency.lockutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.519s {{(pid=88178) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:17:27 devstack cinder-volume[88178]: DEBUG oslo_concurrency.processutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:17:28 devstack sudo[88261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:17:28 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:17:28 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG oslo_concurrency.processutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.262s {{(pid=88178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:17:28 devstack cinder-volume[88178]: INFO cinder.volume.driver [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Driver hasn't implemented _init_vendor_properties()
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG cinder.volume.driver [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576637268066, 'free_capacity_gb': 1775.7576637268066, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88178) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG oslo_db.sqlalchemy.engines [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88178) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG dbcounter [-] [88178] Writer thread running {{(pid=88178) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG cinder.db.api [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Building query based on filter {{(pid=88178) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG cinder.image.image_utils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88178) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 04 09:17:28 devstack cinder-volume[88178]: INFO cinder.keymgr.migration [None req-50b76372-9564-4b56-8111-2434d2c73c62 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG oslo_concurrency.lockutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88178) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG oslo_concurrency.lockutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88178) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG cinder.volume.drivers.quobyte [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88178) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG cinder.volume.drivers.quobyte [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88178) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG oslo_concurrency.lockutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88178) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG oslo_concurrency.processutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:17:28 devstack sudo[88264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:17:28 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:17:28 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG oslo_concurrency.processutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.255s {{(pid=88178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG cinder.manager [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Notifying Schedulers of capabilities ... {{(pid=88178) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:17:28 devstack cinder-volume[88178]: INFO cinder.volume.manager [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Driver initialization completed successfully.
Aug 04 09:17:28 devstack cinder-volume[88178]: INFO cinder.manager [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Initiating service 3 cleanup
Aug 04 09:17:28 devstack cinder-volume[88178]: INFO cinder.manager [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Service 3 cleanup completed.
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG cinder.service [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Creating RPC server for service cinder-volume {{(pid=88178) start /opt/stack/cinder/cinder/service.py:231}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG cinder.service [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88178) start /opt/stack/cinder/cinder/service.py:237}}
Aug 04 09:17:28 devstack cinder-volume[88178]: INFO cinder.volume.manager [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG oslo_concurrency.lockutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88178) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG oslo_concurrency.lockutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88178) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG cinder.volume.drivers.quobyte [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88178) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG cinder.volume.drivers.quobyte [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88178) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG oslo_concurrency.lockutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88178) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:17:28 devstack cinder-volume[88178]: DEBUG oslo_concurrency.processutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:17:28 devstack sudo[88268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:17:28 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:17:29 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root
Aug 04 09:17:29 devstack cinder-volume[88178]: DEBUG oslo_concurrency.processutils [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.309s {{(pid=88178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:17:29 devstack cinder-volume[88178]: INFO cinder.volume.manager [None req-fee0c606-caa7-4f79-9e05-a13468cf7c6e None None] Driver post RPC initialization completed successfully.
Aug 04 09:17:33 devstack cinder-volume[87924]: INFO oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Caught SIGTERM, stopping children
Aug 04 09:17:33 devstack cinder-volume[87924]: DEBUG oslo_concurrency.lockutils [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Acquiring lock "singleton_lock" {{(pid=87924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 04 09:17:33 devstack cinder-volume[87924]: DEBUG oslo_concurrency.lockutils [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Acquired lock "singleton_lock" {{(pid=87924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 04 09:17:33 devstack cinder-volume[87924]: DEBUG oslo_concurrency.lockutils [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Releasing lock "singleton_lock" {{(pid=87924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 04 09:17:33 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Stop services. {{(pid=87924) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Aug 04 09:17:33 devstack cinder-volume[87924]: DEBUG oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Killing children. {{(pid=87924) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Aug 04 09:17:33 devstack cinder-volume[87924]: INFO oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Waiting on 1 children to exit
Aug 04 09:17:34 devstack cinder-volume[88178]: DEBUG oslo_service.periodic_task [None req-03b044c0-0c7c-4b6a-8fd9-5a9daa2bd89b None None] Running periodic task VolumeManager._thread_info {{(pid=88178) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:17:34 devstack cinder-volume[88178]: DEBUG cinder.volume.manager [None req-03b044c0-0c7c-4b6a-8fd9-5a9daa2bd89b None None] thread count: 6 {{(pid=88178) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:17:34 devstack cinder-volume[88178]: DEBUG cinder.volume.manager [None req-03b044c0-0c7c-4b6a-8fd9-5a9daa2bd89b None None] thread info: [<_MainThread(MainThread, started 133932588134528)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133932490008896)>, <Thread(Thread-3 (stat_writer), started daemon 133932476930560)>, <Thread(Rabbit-heartbeat, started daemon 133932475838464)>, <Thread(Thread-5 (_runner), started daemon 133932474870080)>, <Thread(Thread-7 (_runner), started daemon 133932474888256)>] {{(pid=88178) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:17:37 devstack cinder-volume[88178]: DEBUG oslo_concurrency.lockutils [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Acquiring lock "singleton_lock" {{(pid=88178) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 04 09:17:37 devstack cinder-volume[88178]: DEBUG oslo_concurrency.lockutils [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Acquired lock "singleton_lock" {{(pid=88178) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 04 09:17:37 devstack cinder-volume[88178]: DEBUG oslo_concurrency.lockutils [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Releasing lock "singleton_lock" {{(pid=88178) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 04 09:17:37 devstack cinder-volume[88178]: WARNING amqp [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 04 09:17:37 devstack cinder-volume[88178]: WARNING amqp [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 04 09:17:37 devstack cinder-volume[87924]: INFO oslo_service.backend._eventlet.service [None req-86614677-74cb-45da-bf35-dc2e1b6af82b None None] Child 88178 exited with status 0
Aug 04 09:17:37 devstack cinder-volume[88574]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 04 09:17:37 devstack cinder-volume[88574]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 04 09:17:37 devstack cinder-volume[88574]: we strongly recommend against using it for new projects.
Aug 04 09:17:37 devstack cinder-volume[88574]: If you are already using Eventlet, we recommend migrating to a different
Aug 04 09:17:37 devstack cinder-volume[88574]: framework.  For more detail see
Aug 04 09:17:37 devstack cinder-volume[88574]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 04 09:17:37 devstack cinder-volume[88574]:   import eventlet  # noqa
Aug 04 09:17:40 devstack cinder-volume[88574]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88574) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 04 09:17:40 devstack cinder-volume[88574]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88574) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 04 09:17:40 devstack cinder-volume[88574]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88574) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 04 09:17:41 devstack cinder-volume[88574]: INFO dbcounter [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] Registered counter for database cinder
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_db.sqlalchemy.engines [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88574) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG dbcounter [-] [88574] Writer thread running {{(pid=88574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 04 09:17:41 devstack cinder-volume[88574]: INFO cinder.rpc [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 04 09:17:41 devstack cinder-volume[88574]: INFO cinder.rpc [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_db.sqlalchemy.engines [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88574) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:17:41 devstack cinder-volume[88574]: INFO cinder.volume.manager [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] Determined volume DB was empty at startup.
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG cinder.volume.manager [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88574) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 04 09:17:41 devstack cinder-volume[88574]: WARNING stevedore.named [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 04 09:17:41 devstack cinder-volume[88574]: WARNING castellan.key_manager [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 04 09:17:41 devstack cinder-volume[88574]: WARNING cinder.keymgr.conf_key_mgr [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 04 09:17:41 devstack cinder-volume[88574]: INFO cinder.volume.manager [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_db.sqlalchemy.engines [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88574) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:17:41 devstack cinder-volume[88574]: INFO oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] Starting 1 workers
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] Started child 88880 {{(pid=88574) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] Full set of CONF: {{(pid=88574) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] ******************************************************************************** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] Configuration options gathered from: {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] ================================================================================ {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] allow_availability_zone_fallback = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] allow_compression_on_image_upload = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] allowed_direct_url_schemes     = [] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] api_rate_limit                 = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] auth_strategy                  = keystone {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_availability_zone      = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_host                   = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_name                   = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_stats_polling_interval = 60 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backup_api_class               = cinder.backup.api.API {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backup_name_template           = backup-%s {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backup_use_same_host           = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backup_use_temp_snapshot       = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] chap_password                  = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] chap_username                  =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cinder_internal_tenant_project_id = 0f6a5682217645a1a6a0a7da0c2cdc46 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cinder_internal_tenant_user_id = e8f0641eadd444ec9fb3028f4b3a97c1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88880]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cluster                        = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] compression_format             = gzip {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] compute_api_class              = cinder.compute.nova.API {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] config_dir                     = [] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] config_source                  = [] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] control_exchange               = openstack {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] debug                          = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] default_availability_zone      = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] default_group_type             = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] default_volume_type            = QuobyteHD {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] disk_geometry                  = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] driver_client_cert             = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] driver_client_cert_key         = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] driver_data_namespace          = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] driver_ssl_cert_path           = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] driver_ssl_cert_verify         = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] driver_use_ssl                 = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] enable_new_services            = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] enable_unsupported_driver      = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] enabled_backends               = ['QuobyteHD'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] enforce_multipath_for_image_xfer = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] filter_function                = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance_api_insecure            = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance_api_servers             = ['http://192.168.122.129/image'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance_api_ssl_compression     = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance_ca_certificates_file    = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance_catalog_info            = image:glance:publicURL {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance_certfile                = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance_keyfile                 = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance_num_retries             = 3 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance_request_timeout         = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] goodness_function              = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] graceful_shutdown_timeout      = 5 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] group_api_class                = cinder.group.api.API {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] host                           = devstack {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] image_compress_on_upload       = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] image_conversion_address_space_limit = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] image_conversion_cpu_limit     = 60 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] image_conversion_disable       = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] image_upload_use_cinder_backend = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] image_upload_use_internal_tenant = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] image_volume_cache_enabled     = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] image_volume_cache_max_count   = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] image_volume_cache_max_size_gb = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] init_host_max_objects_retrieval = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] instance_format                = [instance: %(uuid)s]  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] iscsi_target_flags             =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] iscsi_write_cache              = on {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] iser_helper                    = tgtadm {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] iser_ip_address                = 192.168.122.129 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] iser_port                      = 3260 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] log_color                      = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] log_config_append              = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] log_dir                        = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] log_file                       = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] log_options                    = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] log_rotate_interval            = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] log_rotate_interval_type       = days {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] log_rotation_type              = none {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] max_age                        = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] max_logfile_count              = 30 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] max_logfile_size_mb            = 200 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] max_over_subscription_ratio    = 20.0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] message_reap_interval          = 86400 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] message_ttl                    = 2592000 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] migration_create_volume_timeout_secs = 300 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] monkey_patch                   = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] monkey_patch_modules           = [] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] my_ip                          = 192.168.122.129 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] no_snapshot_gb_quota           = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] num_iser_scan_tries            = 3 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] num_shell_tries                = 3 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] num_volume_device_scan_tries   = 3 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] nvmeof_conn_info_version       = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] nvmet_ns_id                    = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] nvmet_port_id                  = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] osapi_max_limit                = 1000 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] osapi_volume_ext_list          = [] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] osapi_volume_listen_port       = 8776 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] osapi_volume_use_ssl           = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] osapi_volume_workers           = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] per_volume_size_limit          = -1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] periodic_fuzzy_delay           = 60 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] periodic_interval              = 60 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] public_endpoint                = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] publish_errors                 = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] quota_backup_gigabytes         = 1000 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] quota_backups                  = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] quota_gigabytes                = 1000 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] quota_groups                   = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] quota_snapshots                = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] quota_volumes                  = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] rate_limit_burst               = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] rate_limit_except_level        = CRITICAL {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] rate_limit_interval            = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] reinit_driver_count            = 3 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] replication_device             = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] report_discard_supported       = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] report_interval                = 120 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] reservation_clean_interval     = 86400 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] reservation_expire             = 86400 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] reserved_image_namespaces      = [] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] reserved_percentage            = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] rpc_response_timeout           = 120 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] run_external_periodic_tasks    = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] scst_target_driver             = iscsi {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] scst_target_iqn_name           = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] service_down_time              = 720 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] shell_completion               = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] snapshot_name_template         = snapshot-%s {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] split_loggers                  = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] state_path                     = /opt/stack/data/cinder {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] storage_availability_zone      = nova {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] storage_protocol               = iSCSI {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] syslog_log_facility            = LOG_USER {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] target_helper                  = lioadm {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Starting volume driver QuobyteDriver (1.1.14)
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] target_ip_address              = 192.168.122.129 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88880) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] target_port                    = 3260 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] target_protocol                = iscsi {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] target_secondary_ip_addresses  = [] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] trace_flags                    = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] transport_url                  = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] until_refresh                  = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] use_chap_auth                  = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] use_default_quota_class        = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] use_journal                    = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] use_json                       = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] use_multipath_for_image_xfer   = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] use_stderr                     = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] use_syslog                     = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] verify_glance_signatures       = enabled {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volume_api_class               = cinder.volume.api.API {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volume_backend_name            = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volume_clear                   = zero {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volume_clear_ionice            = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volume_clear_size              = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volume_copy_bps_limit          = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volume_dd_blocksize            = 1M {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volume_name_template           = volume-%s {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volume_service_inithost_offload = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volume_usage_audit_period      = month {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] zoning_mode                    = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_concurrency.disable_process_locking = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.auth_section = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.auth_type   = password {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.auth_version = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.cache       = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.certfile    = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.include_service_catalog = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.insecure    = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.interface   = public {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.keyfile     = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_password =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcache_username =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.region_name = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.service_type = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.129/identity {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.backend                  = dogpile.cache.null {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.backend_argument         = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.backend_expiration_time  = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.config_prefix            = cache.oslo {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.debug_cache_backend      = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.enable_retry_client      = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.enable_socket_keepalive  = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.enabled                  = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.expiration_time          = 600 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.hashclient_retry_attempts = 2 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.memcache_dead_retry      = 300 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.memcache_pool_maxsize    = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.memcache_sasl_enabled    = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.password                 = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.proxies                  = [] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.redis_db                 = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.redis_server             = localhost:6379 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.retry_attempts           = 2 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.retry_delay              = 0.0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.socket_keepalive_count   = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.socket_keepalive_idle    = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.socket_keepalive_interval = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.socket_timeout           = 1.0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.tls_allowed_ciphers      = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.tls_cafile               = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.tls_certfile             = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.tls_enabled              = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.tls_keyfile              = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cache.username                 = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] coordination.backend_url       = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.asyncio_connection    = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.asyncio_slave_connection = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.backend               = sqlalchemy {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.connection            = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.connection_debug      = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.connection_parameters =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.connection_recycle_time = 3600 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.connection_trace      = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.db_inc_retry_interval = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.db_max_retries        = 20 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.db_max_retry_interval = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.db_retry_interval     = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.max_overflow          = 50 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.max_pool_size         = 5 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.max_retries           = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.mysql_wsrep_sync_wait = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.pool_timeout          = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.retry_interval        = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.slave_connection      = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.sqlite_synchronous    = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.synchronous_reader    = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] database.use_db_reconnect      = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler.connection_string     = messaging:// {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler.enabled               = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler.es_doc_type           = notification {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler.es_scroll_size        = 10000 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler.es_scroll_time        = 2m {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler.filter_error_trace    = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler.hmac_keys             = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler.sentinel_service_name = mymaster {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler.socket_timeout        = 0.1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler.trace_requests        = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler.trace_sqlalchemy      = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler_jaeger.process_tags   = {} {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler_jaeger.service_name_prefix = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] profiler_otlp.service_name_prefix = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_policy.enforce_new_defaults = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_policy.policy_default_rule = default {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_policy.policy_file        = policy.yaml {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88880) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Aug 04 09:17:41 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.quobyte [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] privsep_osbrick.group          = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] privsep_osbrick.helper_command = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] privsep_osbrick.user           = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cinder_sys_admin.group         = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cinder_sys_admin.helper_command = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] cinder_sys_admin.user          = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.quobyte [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] service_user.auth_section      = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] service_user.auth_type         = password {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] service_user.cafile            = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] service_user.certfile          = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] service_user.collect_timing    = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Running cmd (subprocess): mount.quobyte {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] service_user.insecure          = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] service_user.keyfile           = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] service_user.send_service_user_token = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] service_user.split_loggers     = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] service_user.timeout           = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance.auth_section            = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance.auth_type               = password {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance.certfile                = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance.collect_timing          = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance.insecure                = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance.keyfile                 = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance.region_name             = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance.split_loggers           = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] glance.timeout                 = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.backend_availability_zone = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.chap_password = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.chap_username =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.disk_geometry = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.driver_client_cert = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.driver_client_cert_key = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.driver_data_namespace = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.driver_use_ssl = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.extra_capabilities = {} {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.filter_function = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.goodness_function = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.iscsi_target_flags =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.iscsi_write_cache = on {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.iser_helper   = tgtadm {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.iser_ip_address = 192.168.122.129 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.iser_port     = 3260 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nas_host      =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nas_login     = admin {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nas_mount_options = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nas_password  = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nas_private_key =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nas_share_path =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.num_shell_tries = 3 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.quobyte_volume_url = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.replication_device = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.report_discard_supported = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.reserved_percentage = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.target_helper = tgtadm {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.target_ip_address = 192.168.122.129 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.target_port   = 3260 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.target_protocol = iscsi {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.trace_flags   = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.unique_fqdn_network = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.use_chap_auth = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.volume_backend_name = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.volume_clear  = zero {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.volume_clear_ionice = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.volume_clear_size = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_reports.file_event_handler = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_reports.log_dir           = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.backend_availability_zone = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.backend_host         = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.chap_password        = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.chap_username        = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.chiscsi_conf         = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.disk_geometry        = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.driver_client_cert   = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.driver_data_namespace = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.driver_use_ssl       = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.extra_capabilities   = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.filter_function      = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.goodness_function    = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.iser_helper          = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.iser_ip_address      = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.iser_port            = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.iser_target_prefix   = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nas_host             = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nas_login            = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nas_mount_options    = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nas_password         = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nas_private_key      = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nas_share_path       = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nas_ssh_port         = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.num_shell_tries      = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack quobyte-client[88884]: Reading configuration file: /etc/quobyte/client.cfg
Aug 04 09:17:41 devstack quobyte-client[88884]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.nvmet_port_id        = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.replication_device   = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.report_discard_supported = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.reserved_percentage  = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.scst_target_driver   = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.storage_protocol     = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.target_helper        = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.target_ip_address    = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.target_port          = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.target_prefix        = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.target_protocol      = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.trace_flags          = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.use_chap_auth        = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.volume_clear         = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.volume_clear_size    = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] QuobyteHD.volumes_dir          = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.ssl      = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_notifications.driver = [] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_notifications.retry = -1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] key_manager.fixed_key          = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.barbican_api_version  = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.barbican_endpoint     = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.barbican_endpoint_type = public {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.barbican_region_name  = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.cafile                = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.certfile              = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.collect_timing        = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.insecure              = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.keyfile               = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.number_of_retries     = 60 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.retry_delay           = 1 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.send_service_user_token = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.split_loggers         = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.timeout               = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.verify_ssl            = True {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican.verify_ssl_path       = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican_service_user.auth_section = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican_service_user.auth_type = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack sudo[88886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican_service_user.cafile   = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican_service_user.certfile = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican_service_user.collect_timing = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican_service_user.insecure = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican_service_user.keyfile  = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican_service_user.split_loggers = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] barbican_service_user.timeout  = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.approle_role_id          = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.approle_secret_id        = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.auth_method              = approle {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.auth_path                = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.kv_mountpoint            = secret {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.kv_path                  = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.kv_version               = 2 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.namespace                = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.root_token_id            = **** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.ssl_ca_crt_file          = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.timeout                  = 60.0 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.token_file               = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.token_role               = None {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.use_ssl                  = False {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 04 09:17:41 devstack cinder-volume[88574]: DEBUG oslo_service.backend._eventlet.service [None req-8771ac6e-1bff-42fd-be8b-8f7ab78e8223 None None] ******************************************************************************** {{(pid=88574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}}
Aug 04 09:17:42 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.261s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:17:42 devstack cinder-volume[88880]: INFO cinder.volume.driver [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Driver hasn't implemented _init_vendor_properties()
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG cinder.volume.driver [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576637268066, 'free_capacity_gb': 1775.7576637268066, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88880) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG oslo_db.sqlalchemy.engines [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88880) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writer thread running {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG cinder.db.api [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Building query based on filter {{(pid=88880) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88880) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:17:42 devstack cinder-volume[88880]: INFO cinder.keymgr.migration [None req-c0e9952b-d4d4-4615-bbaa-ef9545a7b134 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 04 09:17:42 devstack sudo[88897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:17:42 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:17:42 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.268s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:17:42 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Driver initialization completed successfully.
Aug 04 09:17:42 devstack cinder-volume[88880]: INFO cinder.manager [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Initiating service 3 cleanup
Aug 04 09:17:42 devstack cinder-volume[88880]: INFO cinder.manager [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Service 3 cleanup completed.
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG cinder.service [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Creating RPC server for service cinder-volume {{(pid=88880) start /opt/stack/cinder/cinder/service.py:231}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG cinder.service [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88880) start /opt/stack/cinder/cinder/service.py:237}}
Aug 04 09:17:42 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:17:42 devstack sudo[88908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:17:42 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:17:42 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root
Aug 04 09:17:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.234s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:17:42 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2bb97b26-1c1e-427b-a96a-1f573282cb7a None None] Driver post RPC initialization completed successfully.
Aug 04 09:17:51 devstack cinder-volume[88574]: DEBUG dbcounter [-] [88574] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:17:52 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=2 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:17:52 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:18:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:18:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 6 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:18:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Flow 'volume_create_manager' (60a0eb2a-8921-43d7-9142-31e9ad77f9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c851b99a-2ab3-4c4e-83a6-c058e3771c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c851b99a-2ab3-4c4e-83a6-c058e3771c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-636205520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6358c188a5e4fa68d1bdde398ea5c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:18:41Z,use_quota=True,user_id='96819f51a01f47638901fc93b0d2dbbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224ae1ed-7bb4-407d-8dd9-b9775239b650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224ae1ed-7bb4-407d-8dd9-b9775239b650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd97201-2673-4721-9271-1930cd04fee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd97201-2673-4721-9271-1930cd04fee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd', 'volume_name': 'volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff7a924-abb1-4d92-b70e-f0caeb0fdb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff7a924-abb1-4d92-b70e-f0caeb0fdb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06506c0b-1f8d-4eb4-9047-66cea078e444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:41 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Volume e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd', 'volume_size': 1}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-636205520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6358c188a5e4fa68d1bdde398ea5c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:18:41Z,use_quota=True,user_id='96819f51a01f47638901fc93b0d2dbbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Creating volume e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:18:41 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:18:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:41 devstack sudo[89257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd 1073741824
Aug 04 09:18:41 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:42 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd 1073741824" returned: 0 in 1.176s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:42 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd
Aug 04 09:18:42 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:42 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:18:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Flow 'volume_create_manager' (763f5300-e033-4713-933e-4b6b04f775b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:18:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaa68a8-bb96-4c4d-b723-c5adf2523285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:42 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaa68a8-bb96-4c4d-b723-c5adf2523285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-872340800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56fc3fc9-c12f-4ce2-9330-e82d1db2229b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9615131b9144d72ba7f1d0f9d181cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:18:43Z,use_quota=True,user_id='fa81da2c95da48cf9f9e1115ea331875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d060e2-0a9c-490f-8cdf-7c632f124a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d060e2-0a9c-490f-8cdf-7c632f124a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b53cc2-e3af-468f-bec1-14ef074ec08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b53cc2-e3af-468f-bec1-14ef074ec08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56fc3fc9-c12f-4ce2-9330-e82d1db2229b', 'volume_name': 'volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4260d8fe-c708-41ce-bad8-19d872e16931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4260d8fe-c708-41ce-bad8-19d872e16931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34088b3-8504-489e-a282-5a8c92b4aed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:43 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Volume 56fc3fc9-c12f-4ce2-9330-e82d1db2229b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b', 'volume_size': 1}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd" returned: 0 in 0.419s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-872340800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56fc3fc9-c12f-4ce2-9330-e82d1db2229b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9615131b9144d72ba7f1d0f9d181cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:18:43Z,use_quota=True,user_id='fa81da2c95da48cf9f9e1115ea331875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Creating volume 56fc3fc9-c12f-4ce2-9330-e82d1db2229b {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:18:43 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06506c0b-1f8d-4eb4-9047-66cea078e444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84220aac-2730-4f77-ba64-ef81b84ecef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:43 devstack sudo[89592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b 1073741824
Aug 04 09:18:43 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:43 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Volume volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd (e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd): created successfully
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84220aac-2730-4f77-ba64-ef81b84ecef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Flow 'volume_create_manager' (60a0eb2a-8921-43d7-9142-31e9ad77f9e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:18:43 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-60c89f42-5914-487f-9402-10c7987846a2 tempest-VolumeQuotasAdminTestJSON-590308572 None] Created volume successfully.
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Acquiring lock "cinder-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "cinder-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Acquiring lock "cinder-quobyte-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:18:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "cinder-quobyte-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:18:43 devstack cinder-volume[88880]: INFO oslo.privsep.daemon [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpd1hn2ufe/privsep.sock']
Aug 04 09:18:43 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpd1hn2ufe/privsep.sock
Aug 04 09:18:43 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:44 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b 1073741824" returned: 0 in 1.300s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:44 devstack sudo[89635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b
Aug 04 09:18:44 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:44 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b" returned: 0 in 0.398s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:18:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:18:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34088b3-8504-489e-a282-5a8c92b4aed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1687d53-00e9-4266-ab30-59538a7743ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:45 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Volume volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b (56fc3fc9-c12f-4ce2-9330-e82d1db2229b): created successfully
Aug 04 09:18:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1687d53-00e9-4266-ab30-59538a7743ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Flow 'volume_create_manager' (763f5300-e033-4713-933e-4b6b04f775b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:18:45 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a4e23558-a54b-43c8-baac-f4a134c16580 tempest-DeleteServersTestJSON-321861643 None] Created volume successfully.
Aug 04 09:18:46 devstack cinder-volume[88880]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Aug 04 09:18:46 devstack cinder-volume[88880]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 04 09:18:46 devstack cinder-volume[88880]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Aug 04 09:18:46 devstack cinder-volume[88880]: WARNING oslo.privsep.daemon [-] privsep log: 
Aug 04 09:18:46 devstack cinder-volume[88880]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Aug 04 09:18:46 devstack cinder-volume[88880]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Aug 04 09:18:46 devstack cinder-volume[88880]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 04 09:18:46 devstack cinder-volume[88880]: WARNING oslo.privsep.daemon [-] privsep log: 
Aug 04 09:18:46 devstack cinder-volume[88880]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Aug 04 09:18:46 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:46 devstack cinder-volume[88880]: INFO oslo.privsep.daemon [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Spawned new privsep daemon via rootwrap
Aug 04 09:18:46 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Accepted privsep connection to /tmp/tmpd1hn2ufe/privsep.sock {{(pid=88880) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Aug 04 09:18:46 devstack cinder-volume[88880]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 04 09:18:46 devstack cinder-volume[88880]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 04 09:18:46 devstack cinder-volume[88880]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 04 09:18:46 devstack cinder-volume[88880]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89678
Aug 04 09:18:46 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e68e898-8921-4a0e-bf54-3f114b6b2067]: (2,) {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:18:46 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3480bd-59f0-4ef8-a3b8-8755d796db55]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:18:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:47 devstack sudo[89698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd
Aug 04 09:18:47 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:47 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd" returned: 0 in 0.695s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:47 devstack sudo[89707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd
Aug 04 09:18:47 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:48 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd" returned: 0 in 0.585s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "cinder-quobyte-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd" released by "delete_volume" :: held 4.325s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:18:48 devstack cinder-volume[88880]: WARNING cinder.quota [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:18:48 devstack cinder-volume[88880]: WARNING cinder.quota [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:18:48 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Created reservations ['e7516a4b-f465-494f-9d77-dc2b1a85f8d3', '6081500b-7013-47bf-bdd2-bb2ce19bfff9', '9ee062fe-35d6-4391-83b5-20681cfc80af', 'c2e24d65-be28-4fdf-89c5-d3b60cf6945d'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:18:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:18:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:18:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:18:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:18:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:18:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:48 devstack sudo[89716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:18:48 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:49 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.381s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:49 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:18:49 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Deleted volume successfully.
Aug 04 09:18:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c1d1ac6c-d782-409b-8270-31f7fc9ce59c tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "cinder-e35881a4-1a6b-40bd-88e9-9bfdd0fc98dd-delete_volume" released by "delete_volume" :: held 5.288s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Flow 'volume_create_manager' (53daa2cc-3325-4c90-80e8-3c6b1b83b3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dfc0207-a2aa-4585-9718-09760acff785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dfc0207-a2aa-4585-9718-09760acff785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-15443438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccefe98-8ca9-432a-8057-70cca3d6635b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6358c188a5e4fa68d1bdde398ea5c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:18:51Z,use_quota=True,user_id='96819f51a01f47638901fc93b0d2dbbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d418b2e0-9f9a-46f8-9038-e0ca8439afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d418b2e0-9f9a-46f8-9038-e0ca8439afc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d579a23f-0f3f-4b69-9a6a-e6276945695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d579a23f-0f3f-4b69-9a6a-e6276945695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ccefe98-8ca9-432a-8057-70cca3d6635b', 'volume_name': 'volume-9ccefe98-8ca9-432a-8057-70cca3d6635b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce4edaf-c812-4388-9670-e54e1fc0fa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce4edaf-c812-4388-9670-e54e1fc0fa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db77ab0-2641-4ff2-918d-acea96ffd0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:51 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Volume 9ccefe98-8ca9-432a-8057-70cca3d6635b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ccefe98-8ca9-432a-8057-70cca3d6635b', 'volume_size': 1}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-15443438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccefe98-8ca9-432a-8057-70cca3d6635b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6358c188a5e4fa68d1bdde398ea5c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:18:51Z,use_quota=True,user_id='96819f51a01f47638901fc93b0d2dbbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Creating volume 9ccefe98-8ca9-432a-8057-70cca3d6635b {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:18:51 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9ccefe98-8ca9-432a-8057-70cca3d6635b 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:51 devstack sudo[89745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9ccefe98-8ca9-432a-8057-70cca3d6635b 1073741824
Aug 04 09:18:51 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:51 devstack cinder-volume[88880]: WARNING py.warnings [req-ceb2c0f1-91db-4817-87a3-efd0599e6f34 req-b518e515-7e7f-4686-a0e8-c47026028f1b tempest-DeleteServersTestJSON-321861643 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Aug 04 09:18:51 devstack cinder-volume[88880]:   .first()
Aug 04 09:18:51 devstack cinder-volume[88880]: 
Aug 04 09:18:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-ceb2c0f1-91db-4817-87a3-efd0599e6f34 req-b518e515-7e7f-4686-a0e8-c47026028f1b tempest-DeleteServersTestJSON-321861643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:18:52 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9ccefe98-8ca9-432a-8057-70cca3d6635b 1073741824" returned: 0 in 1.175s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9ccefe98-8ca9-432a-8057-70cca3d6635b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:52 devstack sudo[89828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9ccefe98-8ca9-432a-8057-70cca3d6635b
Aug 04 09:18:52 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:52 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9ccefe98-8ca9-432a-8057-70cca3d6635b" returned: 0 in 0.386s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:52 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:18:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:18:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-ceb2c0f1-91db-4817-87a3-efd0599e6f34 req-b518e515-7e7f-4686-a0e8-c47026028f1b tempest-DeleteServersTestJSON-321861643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.365s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:18:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db77ab0-2641-4ff2-918d-acea96ffd0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ccefe98-8ca9-432a-8057-70cca3d6635b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f09e2a-a757-47c9-a354-2717b5d10ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:52 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec942611-bd55-441e-8400-600dc0f56bb1]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:18:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-ceb2c0f1-91db-4817-87a3-efd0599e6f34 req-b518e515-7e7f-4686-a0e8-c47026028f1b tempest-DeleteServersTestJSON-321861643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:53 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Volume volume-9ccefe98-8ca9-432a-8057-70cca3d6635b (9ccefe98-8ca9-432a-8057-70cca3d6635b): created successfully
Aug 04 09:18:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f09e2a-a757-47c9-a354-2717b5d10ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Flow 'volume_create_manager' (53daa2cc-3325-4c90-80e8-3c6b1b83b3aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:18:53 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1a6ba0be-3f8a-4c38-87f2-3e58173c0d79 tempest-VolumeQuotasAdminTestJSON-590308572 None] Created volume successfully.
Aug 04 09:18:53 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b
Aug 04 09:18:53 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:53 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-ceb2c0f1-91db-4817-87a3-efd0599e6f34 req-b518e515-7e7f-4686-a0e8-c47026028f1b tempest-DeleteServersTestJSON-321861643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b" returned: 0 in 0.648s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-ceb2c0f1-91db-4817-87a3-efd0599e6f34 req-b518e515-7e7f-4686-a0e8-c47026028f1b tempest-DeleteServersTestJSON-321861643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.709s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:18:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-ceb2c0f1-91db-4817-87a3-efd0599e6f34 req-b518e515-7e7f-4686-a0e8-c47026028f1b tempest-DeleteServersTestJSON-321861643 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a73ace4-e3f8-4427-8757-b8c4627e1fd7', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:18:53 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-ceb2c0f1-91db-4817-87a3-efd0599e6f34 req-b518e515-7e7f-4686-a0e8-c47026028f1b tempest-DeleteServersTestJSON-321861643 None] attachment_update completed successfully.
Aug 04 09:18:54 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-be199d0e-5725-49e4-8faa-78fea2ffb7a1 tempest-VolumeQuotasAdminTestJSON-1007543654 None] Transfer volume completed successfully.
Aug 04 09:18:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Acquiring lock "cinder-9ccefe98-8ca9-432a-8057-70cca3d6635b-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:18:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Lock "cinder-9ccefe98-8ca9-432a-8057-70cca3d6635b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:18:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Acquiring lock "cinder-quobyte-9ccefe98-8ca9-432a-8057-70cca3d6635b" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:18:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Lock "cinder-quobyte-9ccefe98-8ca9-432a-8057-70cca3d6635b" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:18:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bc0b63-dc9c-4378-a3f9-e92d3e645470]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:18:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9ccefe98-8ca9-432a-8057-70cca3d6635b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:55 devstack sudo[90277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9ccefe98-8ca9-432a-8057-70cca3d6635b
Aug 04 09:18:55 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:56 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9ccefe98-8ca9-432a-8057-70cca3d6635b" returned: 0 in 0.605s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9ccefe98-8ca9-432a-8057-70cca3d6635b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:56 devstack sudo[90283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9ccefe98-8ca9-432a-8057-70cca3d6635b
Aug 04 09:18:56 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:56 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9ccefe98-8ca9-432a-8057-70cca3d6635b" returned: 0 in 0.362s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Lock "cinder-quobyte-9ccefe98-8ca9-432a-8057-70cca3d6635b" released by "delete_volume" :: held 1.104s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:18:56 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Created reservations ['e285d0b2-a292-4aef-ac2f-09857c829728', 'ad1878b1-d87a-4d95-822a-574781bd203c', '7104bbdb-2c06-4f22-bba1-2c0f1181cd83', 'cdd287d0-2b7f-4b4b-984b-cdf0ad09f1c6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:18:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:18:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:18:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:18:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:18:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:18:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:57 devstack sudo[90288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:18:57 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:57 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.610s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:57 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:18:57 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Deleted volume successfully.
Aug 04 09:18:57 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-25a01465-697d-4931-85c0-db6b22196d35 tempest-VolumeQuotasAdminTestJSON-479653808 None] Lock "cinder-9ccefe98-8ca9-432a-8057-70cca3d6635b-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Flow 'volume_create_manager' (5382da1b-24ea-41db-bc2b-41d5470a98f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359082e7-0f80-491f-a442-e588dd671db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359082e7-0f80-491f-a442-e588dd671db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1911607645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4a0ce5-3013-4824-bf66-fa7233bf2df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b72a40152cb491aaf49f3b407730b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:18:58Z,use_quota=True,user_id='201e6d58193e4716b1cc66c507738588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca3b9aba-9e43-41ee-879a-5af0d43ea953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca3b9aba-9e43-41ee-879a-5af0d43ea953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e248a45f-4d91-4b6a-97de-0f1b60be02ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e248a45f-4d91-4b6a-97de-0f1b60be02ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4a0ce5-3013-4824-bf66-fa7233bf2df8', 'volume_name': 'volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bed8ad-30b6-468f-b177-195a1a20d2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bed8ad-30b6-468f-b177-195a1a20d2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84479d0d-926e-48bc-bd8e-30491d7758b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:58 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Volume ae4a0ce5-3013-4824-bf66-fa7233bf2df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8', 'volume_size': 1}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1911607645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4a0ce5-3013-4824-bf66-fa7233bf2df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b72a40152cb491aaf49f3b407730b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:18:58Z,use_quota=True,user_id='201e6d58193e4716b1cc66c507738588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Creating volume ae4a0ce5-3013-4824-bf66-fa7233bf2df8 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:18:58 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:18:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:58 devstack sudo[90343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8 1073741824
Aug 04 09:18:58 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:59 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8 1073741824" returned: 0 in 0.822s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:18:59 devstack sudo[90351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8
Aug 04 09:18:59 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:18:59 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root
Aug 04 09:18:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8" returned: 0 in 0.376s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:18:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:18:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:18:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84479d0d-926e-48bc-bd8e-30491d7758b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50179a0-f6c4-4f3d-b150-10a46166c6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:18:59 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Volume volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8 (ae4a0ce5-3013-4824-bf66-fa7233bf2df8): created successfully
Aug 04 09:18:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50179a0-f6c4-4f3d-b150-10a46166c6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:18:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Flow 'volume_create_manager' (5382da1b-24ea-41db-bc2b-41d5470a98f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:18:59 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2042946a-9290-40db-9c35-d30a82173ece tempest-VolumesAdminNegativeTest-1598292999 None] Created volume successfully.
Aug 04 09:19:00 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-45f50e96-ab90-4637-adfe-cc29d3e858d2 req-28269abe-4383-4eb5-97fe-fa149187bb29 tempest-DeleteServersTestJSON-321861643 None] Terminate volume connection completed successfully.
Aug 04 09:19:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-45f50e96-ab90-4637-adfe-cc29d3e858d2 req-28269abe-4383-4eb5-97fe-fa149187bb29 tempest-DeleteServersTestJSON-321861643 None] Deleting attachment 1a73ace4-e3f8-4427-8757-b8c4627e1fd7. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:19:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Acquiring lock "cinder-ae4a0ce5-3013-4824-bf66-fa7233bf2df8-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:19:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Lock "cinder-ae4a0ce5-3013-4824-bf66-fa7233bf2df8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:19:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Acquiring lock "cinder-quobyte-ae4a0ce5-3013-4824-bf66-fa7233bf2df8" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:19:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Lock "cinder-quobyte-ae4a0ce5-3013-4824-bf66-fa7233bf2df8" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:19:01 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bf5522-788f-496c-b7d1-483aeccd6c55]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:19:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:01 devstack sudo[90357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8
Aug 04 09:19:01 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:02 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8" returned: 0 in 0.662s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:02 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8
Aug 04 09:19:02 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Acquiring lock "cinder-56fc3fc9-c12f-4ce2-9330-e82d1db2229b-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:19:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Lock "cinder-56fc3fc9-c12f-4ce2-9330-e82d1db2229b-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:19:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Acquiring lock "cinder-quobyte-56fc3fc9-c12f-4ce2-9330-e82d1db2229b" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:19:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Lock "cinder-quobyte-56fc3fc9-c12f-4ce2-9330-e82d1db2229b" acquired by "delete_volume" :: waited 0.030s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:19:02 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c093ffa-d15d-44e6-8638-2296ca3222be]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:19:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:02 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ae4a0ce5-3013-4824-bf66-fa7233bf2df8" returned: 0 in 0.502s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Lock "cinder-quobyte-ae4a0ce5-3013-4824-bf66-fa7233bf2df8" released by "delete_volume" :: held 1.240s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:19:03 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Created reservations ['2b240776-da34-4c65-ba73-9e6f5386167b', 'e3089c40-b471-4b85-951c-9566609ba219', '219e5e28-bd79-41f8-bc2f-258bebfae583', '48a7915c-e6d0-4b30-aeff-51c3778cd7d5'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:19:03 devstack sudo[90365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b
Aug 04 09:19:03 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:19:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:19:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:19:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:19:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:19:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:03 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:19:03 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:03 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b" returned: 0 in 0.678s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:03 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.356s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:03 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:19:03 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Deleted volume successfully.
Aug 04 09:19:03 devstack sudo[90374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b
Aug 04 09:19:03 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-730a0198-6ab1-417e-a6d4-2b3a88dd7dec tempest-VolumesAdminNegativeTest-1598292999 None] Lock "cinder-ae4a0ce5-3013-4824-bf66-fa7233bf2df8-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:19:04 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56fc3fc9-c12f-4ce2-9330-e82d1db2229b" returned: 0 in 0.501s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Lock "cinder-quobyte-56fc3fc9-c12f-4ce2-9330-e82d1db2229b" released by "delete_volume" :: held 1.249s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:19:04 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Created reservations ['bd109308-0471-4853-acbe-91d17e6f6238', '58e57d63-f60e-4308-9474-6b064f5b341b', '17e05078-90e9-4ec2-8c80-c8ed50d663a0', 'aa9af7f0-d8c8-4981-85af-2c0d5075d977'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:19:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:19:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:19:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:19:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:19:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:19:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:04 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:19:04 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:04 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.279s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:04 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:19:04 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Deleted volume successfully.
Aug 04 09:19:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-955387a1-586e-44d5-bfe1-9f22fbaac5a3 tempest-DeleteServersTestJSON-321861643 None] Lock "cinder-56fc3fc9-c12f-4ce2-9330-e82d1db2229b-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:19:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:19:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:19:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:19:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:19:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:19:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:19:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:08 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:19:08 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:08 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.241s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:19:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:19:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 8 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:19:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:19:14 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=37,cinder:INSERT=12,cinder:UPDATE=41,cinder:DELETE=3 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:19:14 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=33,cinder:UPDATE=50,cinder:DELETE=5,cinder:INSERT=8 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Flow 'volume_create_manager' (73ddf343-d4ce-4690-b019-6d75c81094bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c220ce2-6c92-40ff-a6f1-7067ae9ab469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c220ce2-6c92-40ff-a6f1-7067ae9ab469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1026302669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4deead-f07e-42d9-9948-dcbd8e1ca7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5c73204e844299b548f9b208318f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:19:17Z,use_quota=True,user_id='8e0ca43868d047a2bcc4f7ac3d770a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f457de-b1e4-4563-8ebd-eca25aedacee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f457de-b1e4-4563-8ebd-eca25aedacee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87023d2-1612-4269-bd4d-09195533c2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87023d2-1612-4269-bd4d-09195533c2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa4deead-f07e-42d9-9948-dcbd8e1ca7ad', 'volume_name': 'volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f46b88-1935-440c-9375-407baf21d47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f46b88-1935-440c-9375-407baf21d47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389b230e-64e0-4dd3-8f23-b44d30505998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:19:17 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Volume fa4deead-f07e-42d9-9948-dcbd8e1ca7ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad', 'volume_size': 1}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1026302669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4deead-f07e-42d9-9948-dcbd8e1ca7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5c73204e844299b548f9b208318f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:19:17Z,use_quota=True,user_id='8e0ca43868d047a2bcc4f7ac3d770a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Creating volume fa4deead-f07e-42d9-9948-dcbd8e1ca7ad {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:19:17 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:17 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad 1073741824
Aug 04 09:19:17 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:17 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad 1073741824" returned: 0 in 0.479s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:17 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad
Aug 04 09:19:17 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:18 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad" returned: 0 in 0.263s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:19:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:19:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389b230e-64e0-4dd3-8f23-b44d30505998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:19:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0831a43e-a154-4afc-8bda-a079b9f7169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:19:18 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Volume volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad (fa4deead-f07e-42d9-9948-dcbd8e1ca7ad): created successfully
Aug 04 09:19:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0831a43e-a154-4afc-8bda-a079b9f7169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:19:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Flow 'volume_create_manager' (73ddf343-d4ce-4690-b019-6d75c81094bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:19:18 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-aef6ec7e-63bf-46d6-931b-0400632e20ff tempest-VolumeQuotasNegativeTestJSON-481765351 None] Created volume successfully.
Aug 04 09:19:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Acquiring lock "cinder-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:19:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Lock "cinder-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:19:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Acquiring lock "cinder-quobyte-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:19:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Lock "cinder-quobyte-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:19:20 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0faed2-0747-4094-ab82-b9dd65c9ad87]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:19:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:21 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad
Aug 04 09:19:21 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:21 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad" returned: 0 in 0.441s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:21 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad
Aug 04 09:19:21 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:21 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad" returned: 0 in 0.283s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Lock "cinder-quobyte-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad" released by "delete_volume" :: held 0.785s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:19:21 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Created reservations ['c5ad2cb7-f774-4acd-9958-0e4f823372e0', 'e901de37-802f-4cab-a190-d5945c6e4fb0', 'dd46010e-4371-4342-aa10-1ea78c44330a', 'e9e1c3d0-b613-489a-8101-adc97f5c2325'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:19:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:19:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:19:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:19:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:19:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:19:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:21 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:19:21 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:22 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.341s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:22 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:19:22 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Deleted volume successfully.
Aug 04 09:19:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7ac9260b-4f1e-4d54-8c35-14f585c63c78 tempest-VolumeQuotasNegativeTestJSON-481765351 None] Lock "cinder-fa4deead-f07e-42d9-9948-dcbd8e1ca7ad-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:19:31 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:19:32 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=12,cinder:SELECT=5,cinder:DELETE=2,cinder:INSERT=2 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:19:53 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Flow 'volume_create_manager' (776a0f89-e7ca-41e0-9dbe-99b66df2de30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37cbbbd6-0372-4331-a06f-f5c087656ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37cbbbd6-0372-4331-a06f-f5c087656ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-721071695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5afd1348-c1c1-4149-90f3-373c1ece9d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbe54ce1bb548929db23f25d99ae119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:19:57Z,use_quota=True,user_id='03abba02b7fb4a78b9a098a67fd3ad30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df3915a-1d3e-4a36-a4cb-58a6d68bd271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df3915a-1d3e-4a36-a4cb-58a6d68bd271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5600b963-2e60-4e11-bd22-6c4dcbcd3ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5600b963-2e60-4e11-bd22-6c4dcbcd3ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5afd1348-c1c1-4149-90f3-373c1ece9d73', 'volume_name': 'volume-5afd1348-c1c1-4149-90f3-373c1ece9d73', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344b9be8-23cb-40aa-9889-2605858090f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344b9be8-23cb-40aa-9889-2605858090f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0008b8-102b-4782-be19-38f484d8a25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:19:57 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Volume 5afd1348-c1c1-4149-90f3-373c1ece9d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5afd1348-c1c1-4149-90f3-373c1ece9d73', 'volume_size': 1}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-721071695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5afd1348-c1c1-4149-90f3-373c1ece9d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbe54ce1bb548929db23f25d99ae119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:19:57Z,use_quota=True,user_id='03abba02b7fb4a78b9a098a67fd3ad30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Creating volume 5afd1348-c1c1-4149-90f3-373c1ece9d73 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:19:57 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:19:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:57 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73 1073741824
Aug 04 09:19:57 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:19:58 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Aug 04 09:19:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73 1073741824" returned: 0 in 1.114s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:19:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:19:59 devstack sudo[90897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73
Aug 04 09:19:59 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:00 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73" returned: 0 in 1.068s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] <== create_volume: return (2344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:20:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.355s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0008b8-102b-4782-be19-38f484d8a25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5afd1348-c1c1-4149-90f3-373c1ece9d73', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284663a6-9cf0-4b9c-80bf-dfa7982ba914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:00 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Volume volume-5afd1348-c1c1-4149-90f3-373c1ece9d73 (5afd1348-c1c1-4149-90f3-373c1ece9d73): created successfully
Aug 04 09:20:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284663a6-9cf0-4b9c-80bf-dfa7982ba914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Flow 'volume_create_manager' (776a0f89-e7ca-41e0-9dbe-99b66df2de30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:00 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a0066491-9bf4-4961-b5a3-a03f5c2e3c24 tempest-VolumesDeleteCascade-657970525 None] Created volume successfully.
Aug 04 09:20:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] Creating offline snapshot f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e of volume 5afd1348-c1c1-4149-90f3-373c1ece9d73 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:20:01 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c55795-8616-420b-bf7e-9cdce494ef9f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:01 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73
Aug 04 09:20:01 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:02 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73" returned: 0 in 0.965s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:02 devstack sudo[90939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e 1G
Aug 04 09:20:02 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:03 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e 1G" returned: 0 in 1.046s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5afd1348-c1c1-4149-90f3-373c1ece9d73 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:03 devstack sudo[90945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5afd1348-c1c1-4149-90f3-373c1ece9d73 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e
Aug 04 09:20:03 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:04 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5afd1348-c1c1-4149-90f3-373c1ece9d73 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e" returned: 0 in 0.768s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:04 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e is being set with open permissions: ugo+rw
Aug 04 09:20:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:04 devstack sudo[90952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e
Aug 04 09:20:04 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:05 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e" returned: 0 in 0.666s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:05 devstack sudo[90963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.info
Aug 04 09:20:05 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:05 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.info" returned: 0 in 0.806s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:05 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.info is being set with open permissions: ugo+rw
Aug 04 09:20:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:05 devstack sudo[90984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.info
Aug 04 09:20:05 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:06 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.info" returned: 0 in 0.462s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.996s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:06 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-c60b238b-c55a-43da-9e47-ac91a19d0994 tempest-VolumesDeleteCascade-657970525 None] Create snapshot completed successfully
Aug 04 09:20:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] Creating offline snapshot 0ebbc446-9ecf-4c13-abc8-d2396557e3b8 of volume 5afd1348-c1c1-4149-90f3-373c1ece9d73 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:20:07 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fef4c84-1b7b-4895-9062-64e50fd3205a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:08 devstack sudo[90995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e
Aug 04 09:20:08 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:20:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:08 devstack sudo[90998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:20:08 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:08 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.487s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:20:08 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e" returned: 0 in 0.816s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5afd1348-c1c1-4149-90f3-373c1ece9d73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:20:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:08 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8 1G
Aug 04 09:20:08 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:09 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8 1G" returned: 0 in 0.644s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:09 devstack sudo[91025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8
Aug 04 09:20:09 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:10 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8" returned: 0 in 0.822s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:10 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8 is being set with open permissions: ugo+rw
Aug 04 09:20:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:10 devstack sudo[91036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8
Aug 04 09:20:10 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:10 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8" returned: 0 in 0.484s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.983s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:10 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-04141b2b-2c94-4b0a-a872-40aa9ff7f856 tempest-VolumesDeleteCascade-657970525 None] Create snapshot completed successfully
Aug 04 09:20:10 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:20:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Flow 'volume_create_manager' (0160e66e-4dbe-4a8a-b9f6-22c78b3adea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd28f9cc-9f67-450f-a502-a331f0b88e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd28f9cc-9f67-450f-a502-a331f0b88e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-838561997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb06ec0-8ef3-4451-84c7-17a5ca97e903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9731ab26edcd47769d5ee09271998d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:11Z,use_quota=True,user_id='f757960189964206ae84acc06a84ce18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ddc2a2-9861-456d-8904-102310160e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ddc2a2-9861-456d-8904-102310160e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228ecdc7-79b1-4461-a1c7-dda5ebe8b306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228ecdc7-79b1-4461-a1c7-dda5ebe8b306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bb06ec0-8ef3-4451-84c7-17a5ca97e903', 'volume_name': 'volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da926e73-f456-46d8-afe0-c47249c4a8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da926e73-f456-46d8-afe0-c47249c4a8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280d4306-6f49-404f-9a64-82a24f3b878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:11 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Volume 2bb06ec0-8ef3-4451-84c7-17a5ca97e903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903', 'volume_size': 1}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-838561997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb06ec0-8ef3-4451-84c7-17a5ca97e903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9731ab26edcd47769d5ee09271998d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:11Z,use_quota=True,user_id='f757960189964206ae84acc06a84ce18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Creating volume 2bb06ec0-8ef3-4451-84c7-17a5ca97e903 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:20:11 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-5afd1348-c1c1-4149-90f3-373c1ece9d73-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-5afd1348-c1c1-4149-90f3-373c1ece9d73-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:11 devstack sudo[91057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903 1073741824
Aug 04 09:20:11 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Performing cascade delete. {{(pid=88880) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-0ebbc446-9ecf-4c13-abc8-d2396557e3b8-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-0ebbc446-9ecf-4c13-abc8-d2396557e3b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-quobyte-5afd1348-c1c1-4149-90f3-373c1ece9d73" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-5afd1348-c1c1-4149-90f3-373c1ece9d73" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-quobyte-0ebbc446-9ecf-4c13-abc8-d2396557e3b8" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-0ebbc446-9ecf-4c13-abc8-d2396557e3b8" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Deleting offline snapshot 0ebbc446-9ecf-4c13-abc8-d2396557e3b8 of volume 5afd1348-c1c1-4149-90f3-373c1ece9d73 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] snapshot_file for this snap is: volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a943af-df4c-4815-8f9c-cf0abd920fe1]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:11 devstack sudo[91072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8
Aug 04 09:20:11 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:12 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903 1073741824" returned: 0 in 0.887s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:12 devstack sudo[91080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903
Aug 04 09:20:12 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:12 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8" returned: 0 in 0.841s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5afd1348-c1c1-4149-90f3-373c1ece9d73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9964c7ca-fa6f-44fd-adab-3a9d0328c77a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:12 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:12 devstack sudo[91085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903" returned: 0 in 0.637s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:12 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280d4306-6f49-404f-9a64-82a24f3b878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096c8b1d-41bf-4e93-8d12-bc3f7c21b091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:12 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Volume volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903 (2bb06ec0-8ef3-4451-84c7-17a5ca97e903): created successfully
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096c8b1d-41bf-4e93-8d12-bc3f7c21b091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Flow 'volume_create_manager' (0160e66e-4dbe-4a8a-b9f6-22c78b3adea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:12 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-737278df-0689-4ee0-89fc-1beac234a2c2 tempest-ServersNegativeTestJSON-470092650 None] Created volume successfully.
Aug 04 09:20:13 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e" returned: 0 in 1.053s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5afd1348-c1c1-4149-90f3-373c1ece9d73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:20:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:13 devstack sudo[91092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8
Aug 04 09:20:13 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:14 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8" returned: 0 in 0.698s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:14 devstack sudo[91098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8
Aug 04 09:20:14 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:14 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.0ebbc446-9ecf-4c13-abc8-d2396557e3b8" returned: 0 in 0.615s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-0ebbc446-9ecf-4c13-abc8-d2396557e3b8" released by "_delete_snapshot" :: held 3.431s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-5afd1348-c1c1-4149-90f3-373c1ece9d73" released by "delete_snapshot" :: held 3.486s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:15 devstack cinder-volume[88880]: WARNING cinder.quota [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:20:15 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Created reservations ['0c3f9014-0ed4-423b-8b02-950d81af2051', 'aa434717-0dd1-41df-811b-0496d1f0c4fd', 'ec2758e2-3adf-40f6-ae9b-897de71d4959', '85e2acd3-15a5-4155-a387-b90b2a558c1e'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:20:15 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Delete snapshot completed successfully.
Aug 04 09:20:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-0ebbc446-9ecf-4c13-abc8-d2396557e3b8-delete_snapshot" released by "delete_snapshot" :: held 3.772s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-quobyte-5afd1348-c1c1-4149-90f3-373c1ece9d73" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-5afd1348-c1c1-4149-90f3-373c1ece9d73" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-quobyte-f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Deleting offline snapshot f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e of volume 5afd1348-c1c1-4149-90f3-373c1ece9d73 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:20:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] snapshot_file for this snap is: volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:20:15 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f04aff-33b1-46c8-acaf-ef2c8a14f9da]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:15 devstack sudo[91103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e
Aug 04 09:20:15 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:16 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e" returned: 0 in 0.728s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5afd1348-c1c1-4149-90f3-373c1ece9d73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:20:16 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[858835a9-4bb4-46e9-9cd2-b6d4163cf8bb]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:16 devstack sudo[91141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73
Aug 04 09:20:16 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:16 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73" returned: 0 in 0.580s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:16 devstack sudo[91146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e
Aug 04 09:20:16 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:17 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e" returned: 0 in 0.650s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:17 devstack sudo[91153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e
Aug 04 09:20:17 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:17 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73.f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e" returned: 0 in 0.367s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:17 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:20:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Flow 'volume_create_manager' (4f400a21-31d0-49da-9987-94119bc75c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf18944c-6196-4dcb-b8e2-fe5113385ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e" released by "_delete_snapshot" :: held 2.600s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-5afd1348-c1c1-4149-90f3-373c1ece9d73" released by "delete_snapshot" :: held 2.652s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf18944c-6196-4dcb-b8e2-fe5113385ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-733983431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728a0e59-f447-423b-99c6-339239d8bde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3809f21f0774795bb9080ddde36edb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:18Z,use_quota=True,user_id='871b165e53184a6e837a4e29196ae528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7089a7-aab6-4111-bd73-ab4c8ea9cf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7089a7-aab6-4111-bd73-ab4c8ea9cf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979a4f60-2a99-4446-bb1a-2fe5903aa032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979a4f60-2a99-4446-bb1a-2fe5903aa032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '728a0e59-f447-423b-99c6-339239d8bde7', 'volume_name': 'volume-728a0e59-f447-423b-99c6-339239d8bde7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273aa8bc-4719-47ed-acc4-cfb2ca434b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273aa8bc-4719-47ed-acc4-cfb2ca434b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdd4f70-0c1c-4de4-b6fb-95ce156d1c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:18 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Volume 728a0e59-f447-423b-99c6-339239d8bde7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-728a0e59-f447-423b-99c6-339239d8bde7', 'volume_size': 1}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-733983431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728a0e59-f447-423b-99c6-339239d8bde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3809f21f0774795bb9080ddde36edb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:18Z,use_quota=True,user_id='871b165e53184a6e837a4e29196ae528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Creating volume 728a0e59-f447-423b-99c6-339239d8bde7 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:20:18 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-728a0e59-f447-423b-99c6-339239d8bde7 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:20:18 devstack sudo[91159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-728a0e59-f447-423b-99c6-339239d8bde7 1073741824
Aug 04 09:20:18 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Flow 'volume_create_manager' (9cb437c8-9824-42f2-a6b5-f352104fb92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bcec0e-afde-4fa8-9121-1a230ddba57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bcec0e-afde-4fa8-9121-1a230ddba57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1911300916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9c1367-c8f2-4158-a787-2398ba6aa248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9731ab26edcd47769d5ee09271998d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:18Z,use_quota=True,user_id='f757960189964206ae84acc06a84ce18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65b01d9-9cf0-47c0-95ac-b62ea7f21e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65b01d9-9cf0-47c0-95ac-b62ea7f21e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a5e6a0-c8a6-4d39-a8b8-c925f7642bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a5e6a0-c8a6-4d39-a8b8-c925f7642bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9c1367-c8f2-4158-a787-2398ba6aa248', 'volume_name': 'volume-0b9c1367-c8f2-4158-a787-2398ba6aa248', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c314f7b-24e8-43d3-8227-3d5b8ba81584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c314f7b-24e8-43d3-8227-3d5b8ba81584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1561e2-1112-4999-a006-fe0895b6a778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:18 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Volume 0b9c1367-c8f2-4158-a787-2398ba6aa248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9c1367-c8f2-4158-a787-2398ba6aa248', 'volume_size': 1}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Created reservations ['c66f550a-dd03-464c-9894-c3b24c534801', '4b7c88df-931e-4ea1-b9aa-96e1fe3e3649', 'a8c2060a-966a-4c20-b08b-50225654959f', 'ab984952-9404-48d3-84ca-eda86f1ee9b6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:20:18 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Delete snapshot completed successfully.
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-f7188da9-2d7e-4b41-8ac5-5efd21eb4a5e-delete_snapshot" released by "delete_snapshot" :: held 3.217s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Snapshots deleted, issuing volume delete {{(pid=88880) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-quobyte-5afd1348-c1c1-4149-90f3-373c1ece9d73" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-5afd1348-c1c1-4149-90f3-373c1ece9d73" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a06df3-e591-4380-8528-001bb9ff0c86]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:18 devstack sudo[91164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73
Aug 04 09:20:18 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:18 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-728a0e59-f447-423b-99c6-339239d8bde7 1073741824" returned: 0 in 0.900s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-728a0e59-f447-423b-99c6-339239d8bde7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:19 devstack sudo[91168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-728a0e59-f447-423b-99c6-339239d8bde7
Aug 04 09:20:19 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:19 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73" returned: 0 in 0.551s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:19 devstack sudo[91173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73
Aug 04 09:20:19 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:19 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-728a0e59-f447-423b-99c6-339239d8bde7" returned: 0 in 0.418s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.246s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1911300916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9c1367-c8f2-4158-a787-2398ba6aa248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9731ab26edcd47769d5ee09271998d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:18Z,use_quota=True,user_id='f757960189964206ae84acc06a84ce18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Creating volume 0b9c1367-c8f2-4158-a787-2398ba6aa248 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:20:19 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b9c1367-c8f2-4158-a787-2398ba6aa248 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdd4f70-0c1c-4de4-b6fb-95ce156d1c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-728a0e59-f447-423b-99c6-339239d8bde7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c22e16-f91c-423b-acba-69f050e46c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:19 devstack sudo[91176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b9c1367-c8f2-4158-a787-2398ba6aa248 1073741824
Aug 04 09:20:19 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:19 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Volume volume-728a0e59-f447-423b-99c6-339239d8bde7 (728a0e59-f447-423b-99c6-339239d8bde7): created successfully
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c22e16-f91c-423b-acba-69f050e46c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Flow 'volume_create_manager' (4f400a21-31d0-49da-9987-94119bc75c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:19 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-16b7f4f7-63b9-4d42-ae47-9eef7f7faf18 tempest-ServerRescueNegativeTestJSON-1894462335 None] Created volume successfully.
Aug 04 09:20:19 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5afd1348-c1c1-4149-90f3-373c1ece9d73" returned: 0 in 0.486s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-5afd1348-c1c1-4149-90f3-373c1ece9d73" released by "delete_volume" :: held 1.245s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Created reservations ['c5f966b2-fbd5-4ad5-9cca-94b35449b7fe', 'eb719f19-d433-449f-bbcc-0890c80c0a0d', 'e341da60-fd1b-4803-8436-25758258d07b', 'f547810c-4879-451d-9872-585f0a80cbf4'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:19 devstack sudo[91182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:20:19 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:20 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b9c1367-c8f2-4158-a787-2398ba6aa248 1073741824" returned: 0 in 0.616s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b9c1367-c8f2-4158-a787-2398ba6aa248 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:20 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.267s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:20 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:20:20 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Deleted volume successfully.
Aug 04 09:20:20 devstack sudo[91186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b9c1367-c8f2-4158-a787-2398ba6aa248
Aug 04 09:20:20 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-969cf3c3-34ec-4d19-8cda-b77ac166cff6 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-5afd1348-c1c1-4149-90f3-373c1ece9d73-delete_volume" released by "delete_volume" :: held 9.004s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:20 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b9c1367-c8f2-4158-a787-2398ba6aa248" returned: 0 in 0.352s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:20:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1561e2-1112-4999-a006-fe0895b6a778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9c1367-c8f2-4158-a787-2398ba6aa248', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89cf037-2eee-4974-8516-5cdd73b468bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:20 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Volume volume-0b9c1367-c8f2-4158-a787-2398ba6aa248 (0b9c1367-c8f2-4158-a787-2398ba6aa248): created successfully
Aug 04 09:20:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89cf037-2eee-4974-8516-5cdd73b468bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Flow 'volume_create_manager' (9cb437c8-9824-42f2-a6b5-f352104fb92f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:20 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-753ad941-d754-4602-889f-992af65d1049 tempest-ServersNegativeTestJSON-470092650 None] Created volume successfully.
Aug 04 09:20:21 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:20:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Flow 'volume_create_manager' (25ec68bd-6872-47c1-a462-1949f296a943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f4983d-eb12-4109-9a82-8a42148a50bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f4983d-eb12-4109-9a82-8a42148a50bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-122964629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e08b48-919c-476b-9b9e-c3b25cf77f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbe54ce1bb548929db23f25d99ae119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:22Z,use_quota=True,user_id='03abba02b7fb4a78b9a098a67fd3ad30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271c34f4-bb4a-4db0-b4a1-f32970970db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271c34f4-bb4a-4db0-b4a1-f32970970db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd6c8e0-d720-47a6-8485-efcd6d302f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd6c8e0-d720-47a6-8485-efcd6d302f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e08b48-919c-476b-9b9e-c3b25cf77f82', 'volume_name': 'volume-51e08b48-919c-476b-9b9e-c3b25cf77f82', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24dc5e3-5dc0-4b65-8fab-645a24bc355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24dc5e3-5dc0-4b65-8fab-645a24bc355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fffb798-d4cc-4204-aa62-075b5e2628eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:22 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Volume 51e08b48-919c-476b-9b9e-c3b25cf77f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e08b48-919c-476b-9b9e-c3b25cf77f82', 'volume_size': 1}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-122964629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e08b48-919c-476b-9b9e-c3b25cf77f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbe54ce1bb548929db23f25d99ae119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:22Z,use_quota=True,user_id='03abba02b7fb4a78b9a098a67fd3ad30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Creating volume 51e08b48-919c-476b-9b9e-c3b25cf77f82 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:20:22 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Acquiring lock "cinder-0b9c1367-c8f2-4158-a787-2398ba6aa248-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:22 devstack sudo[91191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 1073741824
Aug 04 09:20:22 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Lock "cinder-0b9c1367-c8f2-4158-a787-2398ba6aa248-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Acquiring lock "cinder-quobyte-0b9c1367-c8f2-4158-a787-2398ba6aa248" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Lock "cinder-quobyte-0b9c1367-c8f2-4158-a787-2398ba6aa248" acquired by "delete_volume" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f1f7c1-63b2-4260-a5cc-cc0ff903df49]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b9c1367-c8f2-4158-a787-2398ba6aa248 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:22 devstack sudo[91193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b9c1367-c8f2-4158-a787-2398ba6aa248
Aug 04 09:20:22 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:22 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 1073741824" returned: 0 in 0.912s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:23 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b9c1367-c8f2-4158-a787-2398ba6aa248" returned: 0 in 0.685s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b9c1367-c8f2-4158-a787-2398ba6aa248 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:23 devstack sudo[91202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82
Aug 04 09:20:23 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:23 devstack sudo[91203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b9c1367-c8f2-4158-a787-2398ba6aa248
Aug 04 09:20:23 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:23 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82" returned: 0 in 0.495s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fffb798-d4cc-4204-aa62-075b5e2628eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e08b48-919c-476b-9b9e-c3b25cf77f82', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88bb8572-ccde-4771-bd0d-22432ecf4f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:23 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b9c1367-c8f2-4158-a787-2398ba6aa248" returned: 0 in 0.539s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Lock "cinder-quobyte-0b9c1367-c8f2-4158-a787-2398ba6aa248" released by "delete_volume" :: held 1.299s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:23 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Volume volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 (51e08b48-919c-476b-9b9e-c3b25cf77f82): created successfully
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88bb8572-ccde-4771-bd0d-22432ecf4f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Flow 'volume_create_manager' (25ec68bd-6872-47c1-a462-1949f296a943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:23 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2caf4b72-6769-451c-982d-76b3735f49c6 tempest-VolumesDeleteCascade-657970525 None] Created volume successfully.
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Created reservations ['8094f3bc-dbe6-4d28-8182-e408844d2e2e', '52ad1a36-d179-4c26-88cc-d037ec178b99', '2d7951ed-1fe8-449e-8190-b1085cf1f6af', 'ed348f24-ecec-46c1-aafd-50e72f585204'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:23 devstack sudo[91222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:20:23 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] Creating offline snapshot 678d5d40-53f8-4a81-be2c-fc963387d5fe of volume 51e08b48-919c-476b-9b9e-c3b25cf77f82 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[309a2f4d-cd3c-40aa-905c-d079ee543353]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:24 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.578s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:20:24 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Deleted volume successfully.
Aug 04 09:20:24 devstack sudo[91226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82
Aug 04 09:20:24 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-db1adfdf-10f9-4175-9076-4c81fbef0c18 tempest-ServersNegativeTestJSON-470092650 None] Lock "cinder-0b9c1367-c8f2-4158-a787-2398ba6aa248-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Acquiring lock "cinder-2bb06ec0-8ef3-4451-84c7-17a5ca97e903-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Lock "cinder-2bb06ec0-8ef3-4451-84c7-17a5ca97e903-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Acquiring lock "cinder-quobyte-2bb06ec0-8ef3-4451-84c7-17a5ca97e903" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Lock "cinder-quobyte-2bb06ec0-8ef3-4451-84c7-17a5ca97e903" acquired by "delete_volume" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[962bc38f-4bcb-4d4a-8367-7bdf65dc4915]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:24 devstack sudo[91232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903
Aug 04 09:20:24 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:25 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82" returned: 0 in 0.855s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:25 devstack sudo[91242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe 1G
Aug 04 09:20:25 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:25 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903" returned: 0 in 0.657s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:25 devstack sudo[91257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903
Aug 04 09:20:25 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:25 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe 1G" returned: 0 in 0.636s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:25 devstack sudo[91268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe
Aug 04 09:20:25 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:25 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2bb06ec0-8ef3-4451-84c7-17a5ca97e903" returned: 0 in 0.468s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Lock "cinder-quobyte-2bb06ec0-8ef3-4451-84c7-17a5ca97e903" released by "delete_volume" :: held 1.211s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Created reservations ['f682e967-0ad9-433e-96b3-432e09fe787c', 'c13da5ff-bc98-45c5-a6b2-049fad5159d9', '301ea3eb-b2a0-46af-b5b7-f6fc884db871', 'a814bb63-f5cf-4894-be2f-05fb3c17c433'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:26 devstack sudo[91290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:20:26 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:26 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe" returned: 0 in 0.663s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:26 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe is being set with open permissions: ugo+rw
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:26 devstack sudo[91292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe
Aug 04 09:20:26 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:26 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.453s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:20:26 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Deleted volume successfully.
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a6bd84d6-e102-4844-9a87-612c0b8c8c0c tempest-ServersNegativeTestJSON-470092650 None] Lock "cinder-2bb06ec0-8ef3-4451-84c7-17a5ca97e903-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:26 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe" returned: 0 in 0.620s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:27 devstack sudo[91296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.info
Aug 04 09:20:27 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:27 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.info" returned: 0 in 0.524s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:27 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.info is being set with open permissions: ugo+rw
Aug 04 09:20:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:27 devstack sudo[91300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.info
Aug 04 09:20:27 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:28 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.info" returned: 0 in 0.603s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.084s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:28 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-514414ee-9e51-4073-8a8c-6ece79fb907e tempest-VolumesDeleteCascade-657970525 None] Create snapshot completed successfully
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Flow 'volume_create_manager' (8857cd87-613c-44a8-8c2b-349792c14d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d96384-2b25-43f8-ab0b-62e81bb63190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d96384-2b25-43f8-ab0b-62e81bb63190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-486722682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6e71f0-4742-4f17-973a-f1979f8293e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdbe54ce1bb548929db23f25d99ae119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=678d5d40-53f8-4a81-be2c-fc963387d5fe,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:30Z,use_quota=True,user_id='03abba02b7fb4a78b9a098a67fd3ad30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918b08fc-5351-4845-8e64-42c434996fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918b08fc-5351-4845-8e64-42c434996fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340c4dee-a968-49d2-9898-bfb6066c929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340c4dee-a968-49d2-9898-bfb6066c929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5a6e71f0-4742-4f17-973a-f1979f8293e2', 'volume_name': 'volume-5a6e71f0-4742-4f17-973a-f1979f8293e2', 'volume_size': 1, 'snapshot_id': '678d5d40-53f8-4a81-be2c-fc963387d5fe'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd968ac0-f9d5-4e89-82de-494409da74c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd968ac0-f9d5-4e89-82de-494409da74c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd9107b-c287-4b6b-a7dc-8c2811883527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Volume 5a6e71f0-4742-4f17-973a-f1979f8293e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5a6e71f0-4742-4f17-973a-f1979f8293e2', 'volume_size': 1, 'snapshot_id': '678d5d40-53f8-4a81-be2c-fc963387d5fe'}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-quobyte-678d5d40-53f8-4a81-be2c-fc963387d5fe-5a6e71f0-4742-4f17-973a-f1979f8293e2" by "_create_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-678d5d40-53f8-4a81-be2c-fc963387d5fe-5a6e71f0-4742-4f17-973a-f1979f8293e2" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Creating volume 5a6e71f0-4742-4f17-973a-f1979f8293e2 from snapshot 678d5d40-53f8-4a81-be2c-fc963387d5fe {{(pid=88880) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-quobyte-5a6e71f0-4742-4f17-973a-f1979f8293e2" by "_copy_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-5a6e71f0-4742-4f17-973a-f1979f8293e2" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] snapshot: 678d5d40-53f8-4a81-be2c-fc963387d5fe, volume: 5a6e71f0-4742-4f17-973a-f1979f8293e2,  {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[288f8acf-2764-4c5a-bdab-a2ad5720c003]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:30 devstack sudo[91382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe
Aug 04 09:20:30 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:30 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe" returned: 0 in 0.596s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51e08b48-919c-476b-9b9e-c3b25cf77f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Aug 04 09:20:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Creating direct copy from snapshot {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Aug 04 09:20:31 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[64efd218-bebe-4ca0-a1f1-93ad5eaba9dc]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:31 devstack sudo[91389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82
Aug 04 09:20:31 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:31 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82" returned: 0 in 0.763s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:31 devstack cinder-volume[88880]: DEBUG cinder.utils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Path /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2 not found in is_blk_device check {{(pid=88880) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 04 09:20:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:31 devstack sudo[91396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2
Aug 04 09:20:31 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:39 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2" returned: 0 in 7.218s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:39 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e523620-47fe-4fe2-80b5-a35a557149b2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:39 devstack sudo[91473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82
Aug 04 09:20:39 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:40 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82" returned: 0 in 0.979s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82, size 1024.00 MB, duration 7.22 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:20:40 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Converted 1024.00 MB image at 141.84 MB/s
Aug 04 09:20:40 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2 is being set with open permissions: ugo+rw
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:40 devstack sudo[91489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2
Aug 04 09:20:40 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=41,cinder:UPDATE=58,cinder:DELETE=8,cinder:INSERT=9 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=53,cinder:UPDATE=51,cinder:INSERT=18,cinder:DELETE=3 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:20:40 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2" returned: 0 in 0.503s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-5a6e71f0-4742-4f17-973a-f1979f8293e2" released by "_copy_volume_from_snapshot" :: held 10.240s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-678d5d40-53f8-4a81-be2c-fc963387d5fe-5a6e71f0-4742-4f17-973a-f1979f8293e2" released by "_create_volume_from_snapshot" :: held 10.310s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.351s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd9107b-c287-4b6b-a7dc-8c2811883527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6e71f0-4742-4f17-973a-f1979f8293e2', 'volume_size': 1, 'snapshot_id': '678d5d40-53f8-4a81-be2c-fc963387d5fe'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb87671-40a1-4a7f-9898-10b21fa9795a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:40 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Volume volume-5a6e71f0-4742-4f17-973a-f1979f8293e2 (5a6e71f0-4742-4f17-973a-f1979f8293e2): created successfully
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb87671-40a1-4a7f-9898-10b21fa9795a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Flow 'volume_create_manager' (8857cd87-613c-44a8-8c2b-349792c14d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:40 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-273ca9df-fb29-42dd-b9f4-f3b94efac8ad tempest-VolumesDeleteCascade-657970525 None] Created volume successfully.
Aug 04 09:20:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-51e08b48-919c-476b-9b9e-c3b25cf77f82-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-51e08b48-919c-476b-9b9e-c3b25cf77f82-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Performing cascade delete. {{(pid=88880) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Aug 04 09:20:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-678d5d40-53f8-4a81-be2c-fc963387d5fe-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-678d5d40-53f8-4a81-be2c-fc963387d5fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-quobyte-51e08b48-919c-476b-9b9e-c3b25cf77f82" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-51e08b48-919c-476b-9b9e-c3b25cf77f82" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-quobyte-678d5d40-53f8-4a81-be2c-fc963387d5fe" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-678d5d40-53f8-4a81-be2c-fc963387d5fe" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Deleting offline snapshot 678d5d40-53f8-4a81-be2c-fc963387d5fe of volume 51e08b48-919c-476b-9b9e-c3b25cf77f82 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:20:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] snapshot_file for this snap is: volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:20:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f53252f-9df0-468c-b6d8-3a37e5c83d98]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:42 devstack sudo[91510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe
Aug 04 09:20:42 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:42 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe" returned: 0 in 0.532s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51e08b48-919c-476b-9b9e-c3b25cf77f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:20:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e223f4a5-c741-4ee5-998e-69b92bc67dfe]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:42 devstack sudo[91515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82
Aug 04 09:20:42 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:43 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82" returned: 0 in 0.630s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:43 devstack sudo[91520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe
Aug 04 09:20:43 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:43 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe" returned: 0 in 0.520s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:43 devstack sudo[91525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe
Aug 04 09:20:43 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:44 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82.678d5d40-53f8-4a81-be2c-fc963387d5fe" returned: 0 in 0.571s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-678d5d40-53f8-4a81-be2c-fc963387d5fe" released by "_delete_snapshot" :: held 2.470s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-51e08b48-919c-476b-9b9e-c3b25cf77f82" released by "delete_snapshot" :: held 2.528s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:44 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Created reservations ['4ce7e83d-3d28-48ce-8136-c68356376a30', '0236537f-00aa-4c60-b89d-784e7c21ab50', '2d4fc01f-7402-483d-87df-624e70eb210c', '8b689695-f04d-4180-a77d-47280eef74fa'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:20:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Delete snapshot completed successfully.
Aug 04 09:20:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-678d5d40-53f8-4a81-be2c-fc963387d5fe-delete_snapshot" released by "delete_snapshot" :: held 2.868s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Snapshots deleted, issuing volume delete {{(pid=88880) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Aug 04 09:20:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-quobyte-51e08b48-919c-476b-9b9e-c3b25cf77f82" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-51e08b48-919c-476b-9b9e-c3b25cf77f82" acquired by "delete_volume" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:44 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fcb40b-69a0-4749-b7a7-86dd77bd357b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Acquiring lock "cinder-728a0e59-f447-423b-99c6-339239d8bde7-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:44 devstack sudo[91528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82
Aug 04 09:20:44 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Lock "cinder-728a0e59-f447-423b-99c6-339239d8bde7-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Acquiring lock "cinder-quobyte-728a0e59-f447-423b-99c6-339239d8bde7" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Lock "cinder-quobyte-728a0e59-f447-423b-99c6-339239d8bde7" acquired by "delete_volume" :: waited 0.051s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:45 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[252ff4ab-8aae-4bdb-9b45-66deea299178]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-728a0e59-f447-423b-99c6-339239d8bde7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:45 devstack sudo[91530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-728a0e59-f447-423b-99c6-339239d8bde7
Aug 04 09:20:45 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:45 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82" returned: 0 in 0.659s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:45 devstack sudo[91535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82
Aug 04 09:20:45 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:45 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-728a0e59-f447-423b-99c6-339239d8bde7" returned: 0 in 0.691s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-728a0e59-f447-423b-99c6-339239d8bde7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:45 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-51e08b48-919c-476b-9b9e-c3b25cf77f82" returned: 0 in 0.466s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:45 devstack sudo[91542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-728a0e59-f447-423b-99c6-339239d8bde7
Aug 04 09:20:46 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-51e08b48-919c-476b-9b9e-c3b25cf77f82" released by "delete_volume" :: held 1.291s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Created reservations ['0b3be194-3c70-4b0f-91d7-c7e32e832fd4', '2be7cc53-0cb8-4ec7-9d59-1a8cdfce4818', 'fd8f362e-4068-4fbb-a017-bb57729bd74b', '578a5c56-0b8b-41a2-a8de-ddecee77e8c6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:46 devstack sudo[91545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:20:46 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:46 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-728a0e59-f447-423b-99c6-339239d8bde7" returned: 0 in 0.608s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Lock "cinder-quobyte-728a0e59-f447-423b-99c6-339239d8bde7" released by "delete_volume" :: held 1.435s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-5a6e71f0-4742-4f17-973a-f1979f8293e2-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Created reservations ['3dbeb3ed-f9d6-4ad1-ac48-ae5121d68bd8', '479cce34-9bc9-46d0-bace-fd669dbcc934', 'c2798918-1cce-4798-bcf9-16d0ca1e0cad', '84530ed9-7003-4bd1-9b8f-4349fdd890c4'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-5a6e71f0-4742-4f17-973a-f1979f8293e2-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "cinder-quobyte-5a6e71f0-4742-4f17-973a-f1979f8293e2" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:47 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-5a6e71f0-4742-4f17-973a-f1979f8293e2" acquired by "delete_volume" :: waited 0.042s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.672s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:20:47 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Deleted volume successfully.
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[856f3a50-70a4-45d8-b611-3f27563ccfbd]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:47 devstack sudo[91548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:20:47 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5e81537f-59f0-4068-9e16-f736acda225c tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-51e08b48-919c-476b-9b9e-c3b25cf77f82-delete_volume" released by "delete_volume" :: held 5.467s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:47 devstack sudo[91549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2
Aug 04 09:20:47 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:47 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.638s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:20:47 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Deleted volume successfully.
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-34898cd0-b2f5-4217-9f3e-4cb02600a05e tempest-ServerRescueNegativeTestJSON-1894462335 None] Lock "cinder-728a0e59-f447-423b-99c6-339239d8bde7-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:47 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2" returned: 0 in 0.825s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:47 devstack sudo[91558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2
Aug 04 09:20:47 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:48 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Flow 'volume_create_manager' (15737c2c-7ab0-4c59-9c1a-61c411b8924a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d3f422-e023-46bf-954d-57a80a211566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5a6e71f0-4742-4f17-973a-f1979f8293e2" returned: 0 in 0.522s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d3f422-e023-46bf-954d-57a80a211566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-518650914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1acf20-acab-494e-9353-4cd0d6487afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba86abc812a4b5caa2fa26c1afb6950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:48Z,use_quota=True,user_id='473ddefe53044ad48e37fcf7d37ddf7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c89341-ba17-4fe3-92c5-bb0b12840da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c89341-ba17-4fe3-92c5-bb0b12840da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9427cb-e37c-479d-9574-ea2510b5fe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9427cb-e37c-479d-9574-ea2510b5fe1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c1acf20-acab-494e-9353-4cd0d6487afb', 'volume_name': 'volume-9c1acf20-acab-494e-9353-4cd0d6487afb', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5674161e-8379-4ac8-9044-d711ac659d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5674161e-8379-4ac8-9044-d711ac659d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dc3ed9-e6e6-4a10-958d-76711a132cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:48 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Volume 9c1acf20-acab-494e-9353-4cd0d6487afb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c1acf20-acab-494e-9353-4cd0d6487afb', 'volume_size': 1}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-518650914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1acf20-acab-494e-9353-4cd0d6487afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba86abc812a4b5caa2fa26c1afb6950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:48Z,use_quota=True,user_id='473ddefe53044ad48e37fcf7d37ddf7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Creating volume 9c1acf20-acab-494e-9353-4cd0d6487afb {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:20:48 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-quobyte-5a6e71f0-4742-4f17-973a-f1979f8293e2" released by "delete_volume" :: held 1.574s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:48 devstack sudo[91571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb 1073741824
Aug 04 09:20:48 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Created reservations ['c0b7b33b-1971-424d-9cfa-97b91b516a04', '4d4fafc8-a2fc-48ab-a204-db40bce08a86', '36916211-b20c-4833-b98b-ec1cf3df1c1e', 'f36eb916-7046-41b8-9e09-aafa0ab82613'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:48 devstack sudo[91584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:20:48 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:49 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.553s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:49 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:20:49 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Deleted volume successfully.
Aug 04 09:20:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-55565ff6-419d-4f75-a486-230d8fe83073 tempest-VolumesDeleteCascade-657970525 None] Lock "cinder-5a6e71f0-4742-4f17-973a-f1979f8293e2-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:49 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb 1073741824" returned: 0 in 1.019s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:49 devstack sudo[91601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb
Aug 04 09:20:49 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:50 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb" returned: 0 in 0.485s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:20:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dc3ed9-e6e6-4a10-958d-76711a132cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1acf20-acab-494e-9353-4cd0d6487afb', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5e7057-18c2-40d5-9729-d7717fea8aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:50 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Volume volume-9c1acf20-acab-494e-9353-4cd0d6487afb (9c1acf20-acab-494e-9353-4cd0d6487afb): created successfully
Aug 04 09:20:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5e7057-18c2-40d5-9729-d7717fea8aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Flow 'volume_create_manager' (15737c2c-7ab0-4c59-9c1a-61c411b8924a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:50 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-49418bfd-4f4b-4f47-8bbe-d1392067a393 tempest-TaggedAttachmentsTest-1212758924 None] Created volume successfully.
Aug 04 09:20:54 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:20:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Flow 'volume_create_manager' (4e71e1bb-6c8b-4bb0-8520-59faa34ca76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eed79c0-ab5c-41a3-afa4-6aef2a2dc48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eed79c0-ab5c-41a3-afa4-6aef2a2dc48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1090887021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55deebbe-2be7-455a-97c0-6d71a838daaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b8e9c5cb3f43d09add1a90f8425816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:55Z,use_quota=True,user_id='17eeca495a1642b099056b06684278b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3e4862-50d0-4099-99b4-966481b7e4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3e4862-50d0-4099-99b4-966481b7e4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9d9f68-f64b-4fb0-ad71-64d80d4646f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9d9f68-f64b-4fb0-ad71-64d80d4646f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55deebbe-2be7-455a-97c0-6d71a838daaf', 'volume_name': 'volume-55deebbe-2be7-455a-97c0-6d71a838daaf', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856093e9-4727-4bf4-96b7-6d28649d187d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856093e9-4727-4bf4-96b7-6d28649d187d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be18a1d-c0cd-4c22-b8d7-e73ac3ac6316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:55 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Volume 55deebbe-2be7-455a-97c0-6d71a838daaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55deebbe-2be7-455a-97c0-6d71a838daaf', 'volume_size': 1}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1090887021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55deebbe-2be7-455a-97c0-6d71a838daaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b8e9c5cb3f43d09add1a90f8425816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:20:55Z,use_quota=True,user_id='17eeca495a1642b099056b06684278b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Creating volume 55deebbe-2be7-455a-97c0-6d71a838daaf {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:20:55 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55deebbe-2be7-455a-97c0-6d71a838daaf 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:55 devstack sudo[91649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55deebbe-2be7-455a-97c0-6d71a838daaf 1073741824
Aug 04 09:20:55 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:55 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55deebbe-2be7-455a-97c0-6d71a838daaf 1073741824" returned: 0 in 0.450s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55deebbe-2be7-455a-97c0-6d71a838daaf {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:55 devstack sudo[91655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55deebbe-2be7-455a-97c0-6d71a838daaf
Aug 04 09:20:55 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:55 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55deebbe-2be7-455a-97c0-6d71a838daaf" returned: 0 in 0.320s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be18a1d-c0cd-4c22-b8d7-e73ac3ac6316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55deebbe-2be7-455a-97c0-6d71a838daaf', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2bbec6-e57a-471a-b772-964c327660aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:20:55 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Volume volume-55deebbe-2be7-455a-97c0-6d71a838daaf (55deebbe-2be7-455a-97c0-6d71a838daaf): created successfully
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2bbec6-e57a-471a-b772-964c327660aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:20:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Flow 'volume_create_manager' (4e71e1bb-6c8b-4bb0-8520-59faa34ca76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:20:55 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-bfca4a90-b4dd-4822-941c-a71334a29308 tempest-VolumesMetadataTest-1851329725 None] Created volume successfully.
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Acquiring lock "cinder-55deebbe-2be7-455a-97c0-6d71a838daaf-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Lock "cinder-55deebbe-2be7-455a-97c0-6d71a838daaf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Acquiring lock "cinder-quobyte-55deebbe-2be7-455a-97c0-6d71a838daaf" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Lock "cinder-quobyte-55deebbe-2be7-455a-97c0-6d71a838daaf" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b898f1c0-b424-4c78-8330-a5a5de3b07b0]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55deebbe-2be7-455a-97c0-6d71a838daaf {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:58 devstack sudo[91659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55deebbe-2be7-455a-97c0-6d71a838daaf
Aug 04 09:20:58 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:58 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55deebbe-2be7-455a-97c0-6d71a838daaf" returned: 0 in 0.390s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55deebbe-2be7-455a-97c0-6d71a838daaf {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:58 devstack sudo[91664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55deebbe-2be7-455a-97c0-6d71a838daaf
Aug 04 09:20:58 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:58 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55deebbe-2be7-455a-97c0-6d71a838daaf" returned: 0 in 0.299s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Lock "cinder-quobyte-55deebbe-2be7-455a-97c0-6d71a838daaf" released by "delete_volume" :: held 0.736s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Created reservations ['5d11cb73-53bd-4be4-b3a7-5c379b6bd02c', '0a3db059-21ae-4de2-b44c-ac0285097479', '2befb46e-b32e-4cec-b805-57b0fe86fbdb', '118abad9-bf0f-4116-8c51-2d3a39a1842a'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:20:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:20:59 devstack sudo[91668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:20:59 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:20:59 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root
Aug 04 09:20:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.324s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:20:59 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:20:59 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Deleted volume successfully.
Aug 04 09:20:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f12f0d7b-7894-4999-9fc0-fafb10568cf2 tempest-VolumesMetadataTest-1851329725 None] Lock "cinder-55deebbe-2be7-455a-97c0-6d71a838daaf-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:21:07 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:21:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Flow 'volume_create_manager' (38c0fbde-0e55-4d03-8fd2-61306e26bde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:21:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f826c309-3c60-48b7-b485-a65b34f1793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f826c309-3c60-48b7-b485-a65b34f1793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1909638175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d15b44c616a450cb8be7a3dc0dffaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:21:08Z,use_quota=True,user_id='5fd5b8eae76a448894bc396540dfe0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b98002d-8c58-4057-ac3c-b53dd631f1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b98002d-8c58-4057-ac3c-b53dd631f1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd46e45-972f-4989-ab48-abf70eef3845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd46e45-972f-4989-ab48-abf70eef3845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2', 'volume_name': 'volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e662ca46-66f2-4183-bffb-23bd0634194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e662ca46-66f2-4183-bffb-23bd0634194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a176b255-4b8a-49d5-8104-f41f17e3a22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:08 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Volume a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2', 'volume_size': 1}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1909638175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d15b44c616a450cb8be7a3dc0dffaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:21:08Z,use_quota=True,user_id='5fd5b8eae76a448894bc396540dfe0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Creating volume a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:21:08 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:08 devstack sudo[91697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2 1073741824
Aug 04 09:21:08 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:08 devstack sudo[91698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:21:08 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:08 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.358s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 8 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:21:08 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2 1073741824" returned: 0 in 0.552s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:08 devstack sudo[91706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2
Aug 04 09:21:08 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:09 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2" returned: 0 in 0.565s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:21:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a176b255-4b8a-49d5-8104-f41f17e3a22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c4e1ef-5d13-4932-90ab-8d6a19d16192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:09 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Volume volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2 (a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2): created successfully
Aug 04 09:21:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c4e1ef-5d13-4932-90ab-8d6a19d16192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Flow 'volume_create_manager' (38c0fbde-0e55-4d03-8fd2-61306e26bde4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:21:09 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d26edbd7-6729-4a03-9c8a-7a1b2f12fdc8 tempest-VolumesTransfersTest-347818462 None] Created volume successfully.
Aug 04 09:21:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9eecb616-8962-48ee-8ab0-f8fdaba9581d tempest-VolumesTransfersTest-752011569 None] Transfer volume completed successfully.
Aug 04 09:21:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Acquiring lock "cinder-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:21:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Lock "cinder-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:21:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Acquiring lock "cinder-quobyte-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:21:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Lock "cinder-quobyte-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2" acquired by "delete_volume" :: waited 0.031s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:21:12 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4d462c-1b4f-43a8-8224-1b0c58bda4c6]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:21:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:12 devstack sudo[91816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2
Aug 04 09:21:12 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:13 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2" returned: 0 in 0.764s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:13 devstack sudo[91823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2
Aug 04 09:21:13 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:13 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2" returned: 0 in 0.362s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Lock "cinder-quobyte-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2" released by "delete_volume" :: held 1.191s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:21:13 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Created reservations ['c0abccf3-e966-4a1f-a5b7-1ed0f1b4e7be', '5023a787-9367-4e96-8ecf-3d0854d19171', 'c976bc92-ce69-4b31-98c4-9aca19834615', '1988e392-277c-4ccf-9cff-176a9e7c1d43'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:21:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:21:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:21:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:13 devstack sudo[91826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:21:13 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:14 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.447s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:14 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:21:14 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Deleted volume successfully.
Aug 04 09:21:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-63dfe6fa-44df-474c-a2f8-34cd65e5b311 tempest-VolumesTransfersTest-322105308 None] Lock "cinder-a68d9a0a-47b8-418a-aa9d-4e5d9cd351b2-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Flow 'volume_create_manager' (48ee14cb-65f7-44c0-a1a6-339a4490c7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62ae3ef-0c4a-4d21-8558-53af886c7843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62ae3ef-0c4a-4d21-8558-53af886c7843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-47841796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5781c1a6-4782-4b4d-8f84-16f680481da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d15b44c616a450cb8be7a3dc0dffaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:21:16Z,use_quota=True,user_id='5fd5b8eae76a448894bc396540dfe0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45879adf-62fb-4e91-8b37-2ad2de45acfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45879adf-62fb-4e91-8b37-2ad2de45acfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f07dd0b-3a87-43ab-9ced-1abb897f714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f07dd0b-3a87-43ab-9ced-1abb897f714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5781c1a6-4782-4b4d-8f84-16f680481da2', 'volume_name': 'volume-5781c1a6-4782-4b4d-8f84-16f680481da2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e494b33b-9032-4d7a-890b-486e80896c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e494b33b-9032-4d7a-890b-486e80896c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ef9c17-cb5e-4229-8dc8-1ef05b1bfc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:15 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Volume 5781c1a6-4782-4b4d-8f84-16f680481da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5781c1a6-4782-4b4d-8f84-16f680481da2', 'volume_size': 1}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-47841796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5781c1a6-4782-4b4d-8f84-16f680481da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d15b44c616a450cb8be7a3dc0dffaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:21:16Z,use_quota=True,user_id='5fd5b8eae76a448894bc396540dfe0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Creating volume 5781c1a6-4782-4b4d-8f84-16f680481da2 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:21:15 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:21:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5781c1a6-4782-4b4d-8f84-16f680481da2 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:15 devstack sudo[91863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5781c1a6-4782-4b4d-8f84-16f680481da2 1073741824
Aug 04 09:21:15 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:16 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5781c1a6-4782-4b4d-8f84-16f680481da2 1073741824" returned: 0 in 0.812s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5781c1a6-4782-4b4d-8f84-16f680481da2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:16 devstack sudo[91891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5781c1a6-4782-4b4d-8f84-16f680481da2
Aug 04 09:21:16 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:17 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5781c1a6-4782-4b4d-8f84-16f680481da2" returned: 0 in 0.479s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:21:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ef9c17-cb5e-4229-8dc8-1ef05b1bfc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5781c1a6-4782-4b4d-8f84-16f680481da2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3894af1-9300-4a18-bef0-3603e9cf7448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:17 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Volume volume-5781c1a6-4782-4b4d-8f84-16f680481da2 (5781c1a6-4782-4b4d-8f84-16f680481da2): created successfully
Aug 04 09:21:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3894af1-9300-4a18-bef0-3603e9cf7448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Flow 'volume_create_manager' (48ee14cb-65f7-44c0-a1a6-339a4490c7c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:21:17 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d1a2ada6-43ab-4c38-bdaf-f96a5bbb46db tempest-VolumesTransfersTest-347818462 None] Created volume successfully.
Aug 04 09:21:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Acquiring lock "cinder-5781c1a6-4782-4b4d-8f84-16f680481da2-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:21:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Lock "cinder-5781c1a6-4782-4b4d-8f84-16f680481da2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:21:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Acquiring lock "cinder-quobyte-5781c1a6-4782-4b4d-8f84-16f680481da2" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:21:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Lock "cinder-quobyte-5781c1a6-4782-4b4d-8f84-16f680481da2" acquired by "delete_volume" :: waited 0.043s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:21:18 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8249f8-ed58-463a-90f3-2cb6d1525eec]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:21:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5781c1a6-4782-4b4d-8f84-16f680481da2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:18 devstack sudo[91922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5781c1a6-4782-4b4d-8f84-16f680481da2
Aug 04 09:21:18 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:19 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5781c1a6-4782-4b4d-8f84-16f680481da2" returned: 0 in 0.726s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5781c1a6-4782-4b4d-8f84-16f680481da2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:19 devstack sudo[91928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5781c1a6-4782-4b4d-8f84-16f680481da2
Aug 04 09:21:19 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:19 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5781c1a6-4782-4b4d-8f84-16f680481da2" returned: 0 in 0.477s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Lock "cinder-quobyte-5781c1a6-4782-4b4d-8f84-16f680481da2" released by "delete_volume" :: held 1.310s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:21:20 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Created reservations ['d17a3e44-5099-403d-8484-e03950db31e6', 'ff8e2bb5-96f1-4f1f-bc76-e0cce83c0298', '5f619613-a139-406e-b613-fc2a2d4f8667', '9dee2924-1341-42c3-aa52-236efda40484'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:21:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:21:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:21:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:20 devstack sudo[91936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:21:20 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:21 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.834s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:21 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:21:21 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Deleted volume successfully.
Aug 04 09:21:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-01f8aab8-d084-4042-9435-88225ea97964 tempest-VolumesTransfersTest-322105308 None] Lock "cinder-5781c1a6-4782-4b4d-8f84-16f680481da2-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:21:30 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=43,cinder:INSERT=15,cinder:UPDATE=65,cinder:DELETE=4 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:21:31 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=69,cinder:DELETE=7,cinder:SELECT=46,cinder:INSERT=17 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Flow 'volume_create_manager' (5ec5634d-8279-4c71-91ff-290552aaa523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028762fb-b9c3-4052-bbdb-f9b22bc95710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028762fb-b9c3-4052-bbdb-f9b22bc95710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-248263517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af64068a-4723-4bdb-9bc1-fd44f9b58086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3734c17f4246438ee77f56bf927301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:21:33Z,use_quota=True,user_id='9147b1f4b6cd424282358e4f283d10b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c641a6-a72c-47d9-999f-514c7bdc7b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c641a6-a72c-47d9-999f-514c7bdc7b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7324623a-1615-4b79-8e05-ea044a7cd4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7324623a-1615-4b79-8e05-ea044a7cd4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af64068a-4723-4bdb-9bc1-fd44f9b58086', 'volume_name': 'volume-af64068a-4723-4bdb-9bc1-fd44f9b58086', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ae8802-c707-42fa-8f6d-ea27102708a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ae8802-c707-42fa-8f6d-ea27102708a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8130a5-d647-4ae1-9faf-c815d580fe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:33 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Volume af64068a-4723-4bdb-9bc1-fd44f9b58086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af64068a-4723-4bdb-9bc1-fd44f9b58086', 'volume_size': 1}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-248263517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af64068a-4723-4bdb-9bc1-fd44f9b58086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3734c17f4246438ee77f56bf927301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:21:33Z,use_quota=True,user_id='9147b1f4b6cd424282358e4f283d10b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Creating volume af64068a-4723-4bdb-9bc1-fd44f9b58086 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:21:33 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:21:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-af64068a-4723-4bdb-9bc1-fd44f9b58086 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:33 devstack sudo[92021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-af64068a-4723-4bdb-9bc1-fd44f9b58086 1073741824
Aug 04 09:21:33 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:34 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-af64068a-4723-4bdb-9bc1-fd44f9b58086 1073741824" returned: 0 in 0.816s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-af64068a-4723-4bdb-9bc1-fd44f9b58086 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:34 devstack sudo[92055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-af64068a-4723-4bdb-9bc1-fd44f9b58086
Aug 04 09:21:34 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:34 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-af64068a-4723-4bdb-9bc1-fd44f9b58086" returned: 0 in 0.260s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:21:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8130a5-d647-4ae1-9faf-c815d580fe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af64068a-4723-4bdb-9bc1-fd44f9b58086', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee318aea-5fee-4878-aed8-7c50c27f0963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:34 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Volume volume-af64068a-4723-4bdb-9bc1-fd44f9b58086 (af64068a-4723-4bdb-9bc1-fd44f9b58086): created successfully
Aug 04 09:21:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee318aea-5fee-4878-aed8-7c50c27f0963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Flow 'volume_create_manager' (5ec5634d-8279-4c71-91ff-290552aaa523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:21:34 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4f3fa85f-355d-43dc-aa67-063340e82727 tempest-VolumesTransfersV357Test-1763842194 None] Created volume successfully.
Aug 04 09:21:35 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-81a51b32-379e-4857-acc8-6a4149f05503 tempest-VolumesTransfersV357Test-844368402 None] Transfer volume completed successfully.
Aug 04 09:21:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Acquiring lock "cinder-af64068a-4723-4bdb-9bc1-fd44f9b58086-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:21:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Lock "cinder-af64068a-4723-4bdb-9bc1-fd44f9b58086-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:21:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Acquiring lock "cinder-quobyte-af64068a-4723-4bdb-9bc1-fd44f9b58086" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:21:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Lock "cinder-quobyte-af64068a-4723-4bdb-9bc1-fd44f9b58086" acquired by "delete_volume" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:21:36 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c828084-938f-4750-b6d2-22ef0cd2afd6]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:21:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-af64068a-4723-4bdb-9bc1-fd44f9b58086 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:37 devstack sudo[92125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-af64068a-4723-4bdb-9bc1-fd44f9b58086
Aug 04 09:21:37 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:37 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-af64068a-4723-4bdb-9bc1-fd44f9b58086" returned: 0 in 0.424s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-af64068a-4723-4bdb-9bc1-fd44f9b58086 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:37 devstack sudo[92150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-af64068a-4723-4bdb-9bc1-fd44f9b58086
Aug 04 09:21:37 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:37 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-af64068a-4723-4bdb-9bc1-fd44f9b58086" returned: 0 in 0.263s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Lock "cinder-quobyte-af64068a-4723-4bdb-9bc1-fd44f9b58086" released by "delete_volume" :: held 0.768s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:21:37 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Created reservations ['c171e32d-2b11-4300-ab2e-87cee881bbe0', '5bafce9d-e1a9-4512-ba7c-b7bfcc8160f5', 'bb6dd839-bf34-4689-acb2-e7827b5220ea', 'c9a3bec5-2c23-4de7-a041-f9985da1e824'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:21:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:21:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:21:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:37 devstack sudo[92155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:21:37 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:38 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.330s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:21:38 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Deleted volume successfully.
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c0977d0-d0e5-4fcb-87d9-9fcebf931d55 tempest-VolumesTransfersV357Test-1253774134 None] Lock "cinder-af64068a-4723-4bdb-9bc1-fd44f9b58086-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Flow 'volume_create_manager' (965876f7-ee72-4535-be5f-89180b1276cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8cc07f-3fbd-402c-9bbc-9c57f2e45729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8cc07f-3fbd-402c-9bbc-9c57f2e45729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-911537529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0cd73c-8018-43de-848f-5f32c8eab11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3734c17f4246438ee77f56bf927301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:21:39Z,use_quota=True,user_id='9147b1f4b6cd424282358e4f283d10b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4cba30-6b32-4568-8030-0c8432ea0fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4cba30-6b32-4568-8030-0c8432ea0fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dce77b2-8a29-4277-b957-e765e8ad3a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dce77b2-8a29-4277-b957-e765e8ad3a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0cd73c-8018-43de-848f-5f32c8eab11b', 'volume_name': 'volume-3f0cd73c-8018-43de-848f-5f32c8eab11b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187229fd-df1b-4a64-b5cf-b52de4bb4b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187229fd-df1b-4a64-b5cf-b52de4bb4b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a83117-fd48-4d73-b0ab-748a13379fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:38 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Volume 3f0cd73c-8018-43de-848f-5f32c8eab11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0cd73c-8018-43de-848f-5f32c8eab11b', 'volume_size': 1}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-911537529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0cd73c-8018-43de-848f-5f32c8eab11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3734c17f4246438ee77f56bf927301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:21:39Z,use_quota=True,user_id='9147b1f4b6cd424282358e4f283d10b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Creating volume 3f0cd73c-8018-43de-848f-5f32c8eab11b {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:21:38 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:21:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3f0cd73c-8018-43de-848f-5f32c8eab11b 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:39 devstack sudo[92161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3f0cd73c-8018-43de-848f-5f32c8eab11b 1073741824
Aug 04 09:21:39 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:39 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3f0cd73c-8018-43de-848f-5f32c8eab11b 1073741824" returned: 0 in 0.565s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3f0cd73c-8018-43de-848f-5f32c8eab11b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:39 devstack sudo[92168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3f0cd73c-8018-43de-848f-5f32c8eab11b
Aug 04 09:21:39 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:40 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3f0cd73c-8018-43de-848f-5f32c8eab11b" returned: 0 in 0.397s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:21:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a83117-fd48-4d73-b0ab-748a13379fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0cd73c-8018-43de-848f-5f32c8eab11b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd910ff6-a8b5-4ff6-9acc-1dfac445884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:40 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Volume volume-3f0cd73c-8018-43de-848f-5f32c8eab11b (3f0cd73c-8018-43de-848f-5f32c8eab11b): created successfully
Aug 04 09:21:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd910ff6-a8b5-4ff6-9acc-1dfac445884b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Flow 'volume_create_manager' (965876f7-ee72-4535-be5f-89180b1276cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:21:40 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e5a9a07b-5196-4c41-bfba-7587a61c5518 tempest-VolumesTransfersV357Test-1763842194 None] Created volume successfully.
Aug 04 09:21:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Acquiring lock "cinder-3f0cd73c-8018-43de-848f-5f32c8eab11b-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:21:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Lock "cinder-3f0cd73c-8018-43de-848f-5f32c8eab11b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:21:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Acquiring lock "cinder-quobyte-3f0cd73c-8018-43de-848f-5f32c8eab11b" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:21:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Lock "cinder-quobyte-3f0cd73c-8018-43de-848f-5f32c8eab11b" acquired by "delete_volume" :: waited 0.051s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:21:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[84087fae-375c-4cde-8fa9-ca12938761eb]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:21:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3f0cd73c-8018-43de-848f-5f32c8eab11b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:42 devstack sudo[92241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3f0cd73c-8018-43de-848f-5f32c8eab11b
Aug 04 09:21:42 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:43 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3f0cd73c-8018-43de-848f-5f32c8eab11b" returned: 0 in 1.085s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3f0cd73c-8018-43de-848f-5f32c8eab11b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:43 devstack sudo[92258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3f0cd73c-8018-43de-848f-5f32c8eab11b
Aug 04 09:21:43 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:44 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3f0cd73c-8018-43de-848f-5f32c8eab11b" returned: 0 in 0.538s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Lock "cinder-quobyte-3f0cd73c-8018-43de-848f-5f32c8eab11b" released by "delete_volume" :: held 1.749s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:21:44 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Created reservations ['70e9b10f-47dc-41d1-924f-2ce70c15e602', '85b6f6f4-6d2e-4a13-b809-29c58f756ae6', '5fb79f26-eb0d-414a-a902-2170277063c3', 'c43bb196-68f0-453e-9ffa-a7155d78481c'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:21:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:21:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:21:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:44 devstack sudo[92268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:21:44 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:44 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.351s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:44 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:21:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Deleted volume successfully.
Aug 04 09:21:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-de270e6a-374b-401d-bcda-36463469d9ad tempest-VolumesTransfersV357Test-1253774134 None] Lock "cinder-3f0cd73c-8018-43de-848f-5f32c8eab11b-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:21:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-ea6fa779-f034-416e-ba7f-860bc550b492 req-7dff5cf5-ba35-4561-a952-82538a2279dc tempest-TaggedAttachmentsTest-1212758924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-ea6fa779-f034-416e-ba7f-860bc550b492 req-7dff5cf5-ba35-4561-a952-82538a2279dc tempest-TaggedAttachmentsTest-1212758924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:45 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f276aca-6ab7-4c05-8d66-cd7de5d10527]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:21:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-ea6fa779-f034-416e-ba7f-860bc550b492 req-7dff5cf5-ba35-4561-a952-82538a2279dc tempest-TaggedAttachmentsTest-1212758924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:45 devstack sudo[92281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb
Aug 04 09:21:45 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:45 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-ea6fa779-f034-416e-ba7f-860bc550b492 req-7dff5cf5-ba35-4561-a952-82538a2279dc tempest-TaggedAttachmentsTest-1212758924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb" returned: 0 in 0.510s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-ea6fa779-f034-416e-ba7f-860bc550b492 req-7dff5cf5-ba35-4561-a952-82538a2279dc tempest-TaggedAttachmentsTest-1212758924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.540s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-ea6fa779-f034-416e-ba7f-860bc550b492 req-7dff5cf5-ba35-4561-a952-82538a2279dc tempest-TaggedAttachmentsTest-1212758924 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-9c1acf20-acab-494e-9353-4cd0d6487afb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '084ecd35-3412-4975-a281-9b16aaca0d8c', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:21:45 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-ea6fa779-f034-416e-ba7f-860bc550b492 req-7dff5cf5-ba35-4561-a952-82538a2279dc tempest-TaggedAttachmentsTest-1212758924 None] attachment_update completed successfully.
Aug 04 09:21:48 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-a4a81cf1-30be-4c72-a330-dce271073c54 req-03cbd643-8671-4386-ace0-2566129e6c82 tempest-TaggedAttachmentsTest-1212758924 None] Terminate volume connection completed successfully.
Aug 04 09:21:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-a4a81cf1-30be-4c72-a330-dce271073c54 req-03cbd643-8671-4386-ace0-2566129e6c82 tempest-TaggedAttachmentsTest-1212758924 None] Deleting attachment 084ecd35-3412-4975-a281-9b16aaca0d8c. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Flow 'volume_create_manager' (b9e2990b-b9db-4184-8ac2-a228658c3cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512db9b4-a68d-4f93-9f73-0929161c4ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512db9b4-a68d-4f93-9f73-0929161c4ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1101794028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb527ed-578e-4bff-9575-f7faa9366e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd2d535b9f4e15adeacc81d312b555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:21:49Z,use_quota=True,user_id='e957010905464eb9916ae755ac1b7ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2f8c32-8522-4e67-9f4a-3d32fbe23eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2f8c32-8522-4e67-9f4a-3d32fbe23eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec1d257-38f2-47d3-afb2-e72caeacf219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec1d257-38f2-47d3-afb2-e72caeacf219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb527ed-578e-4bff-9575-f7faa9366e69', 'volume_name': 'volume-afb527ed-578e-4bff-9575-f7faa9366e69', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a54ced-0771-4212-9621-e76c8ac7efa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a54ced-0771-4212-9621-e76c8ac7efa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c229ca3-2ca7-4bd7-ade7-2e50d4d98b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:49 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Volume afb527ed-578e-4bff-9575-f7faa9366e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb527ed-578e-4bff-9575-f7faa9366e69', 'volume_size': 1}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1101794028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb527ed-578e-4bff-9575-f7faa9366e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd2d535b9f4e15adeacc81d312b555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:21:49Z,use_quota=True,user_id='e957010905464eb9916ae755ac1b7ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Creating volume afb527ed-578e-4bff-9575-f7faa9366e69 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:21:49 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:21:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:49 devstack sudo[92715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69 1073741824
Aug 04 09:21:49 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:50 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69 1073741824" returned: 0 in 1.111s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:50 devstack sudo[92740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69
Aug 04 09:21:50 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:51 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69" returned: 0 in 0.496s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:21:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c229ca3-2ca7-4bd7-ade7-2e50d4d98b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb527ed-578e-4bff-9575-f7faa9366e69', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e15e278-0385-4148-8513-997c5999c9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:51 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Volume volume-afb527ed-578e-4bff-9575-f7faa9366e69 (afb527ed-578e-4bff-9575-f7faa9366e69): created successfully
Aug 04 09:21:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e15e278-0385-4148-8513-997c5999c9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Flow 'volume_create_manager' (b9e2990b-b9db-4184-8ac2-a228658c3cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:21:51 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-5d22417f-5bc9-4cac-82db-36ab3cd62e78 tempest-AttachVolumeTestJSON-1848473781 None] Created volume successfully.
Aug 04 09:21:53 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:21:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Flow 'volume_create_manager' (43d66fd6-6c9b-4643-92b7-dbe65893aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:21:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb36e572-f837-4e8c-812f-a387b2a0fdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb36e572-f837-4e8c-812f-a387b2a0fdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-457937488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d85860c-c809-4509-bab8-b6853b3b6a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e2b709215441a793dcf8e3d00fa2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:21:54Z,use_quota=True,user_id='4b49729593e64978a747b2de42f7a65c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9354e4cb-cdbe-440e-b0ba-09b50fd8b648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9354e4cb-cdbe-440e-b0ba-09b50fd8b648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d991de-7a3e-4b77-9142-a40f9b25e67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:53 devstack cinder-volume[88880]: DEBUG cinder.image.glance [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Creating Keystone auth plugin from conf {{(pid=88880) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 04 09:21:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-8a471786-7463-4ab6-b0b4-16420828f525 req-7a43898d-6beb-48db-b838-cf592ed01d08 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-8a471786-7463-4ab6-b0b4-16420828f525 req-7a43898d-6beb-48db-b838-cf592ed01d08 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:53 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[15995d14-bc83-4d20-be94-59d4e4a5d4a6]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:21:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-8a471786-7463-4ab6-b0b4-16420828f525 req-7a43898d-6beb-48db-b838-cf592ed01d08 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:53 devstack sudo[92790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69
Aug 04 09:21:53 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d991de-7a3e-4b77-9142-a40f9b25e67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d85860c-c809-4509-bab8-b6853b3b6a8c', 'volume_name': 'volume-7d85860c-c809-4509-bab8-b6853b3b6a8c', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba1191c0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d4f346-ae22-431d-9424-9a7ddc83ba9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d4f346-ae22-431d-9424-9a7ddc83ba9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:21:54 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6d76e0-76cf-455e-84f9-a5d249f66bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:21:54 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Volume 7d85860c-c809-4509-bab8-b6853b3b6a8c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d85860c-c809-4509-bab8-b6853b3b6a8c', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba1191c0>}
Aug 04 09:21:54 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Trying to clone 7d85860c-c809-4509-bab8-b6853b3b6a8c from image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]). {{(pid=88880) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 04 09:21:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-8a471786-7463-4ab6-b0b4-16420828f525 req-7a43898d-6beb-48db-b838-cf592ed01d08 tempest-AttachVolumeTestJSON-1848473781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69" returned: 0 in 0.430s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-8a471786-7463-4ab6-b0b4-16420828f525 req-7a43898d-6beb-48db-b838-cf592ed01d08 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.457s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-8a471786-7463-4ab6-b0b4-16420828f525 req-7a43898d-6beb-48db-b838-cf592ed01d08 tempest-AttachVolumeTestJSON-1848473781 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-afb527ed-578e-4bff-9575-f7faa9366e69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73350b03-410a-4182-8356-971ebf6946ec', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:21:54 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-8a471786-7463-4ab6-b0b4-16420828f525 req-7a43898d-6beb-48db-b838-cf592ed01d08 tempest-AttachVolumeTestJSON-1848473781 None] attachment_update completed successfully.
Aug 04 09:21:54 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 04 09:21:54 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Image download 20.69 MB at 20.69 MB/s
Aug 04 09:21:54 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f012599a-3470-4d98-af8a-ccfa9910a7f3]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:21:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:54 devstack sudo[92903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD
Aug 04 09:21:54 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:55 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Temporary image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 is fetched for user 4b49729593e64978a747b2de42f7a65c. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5698643f-66a3-4761-ae94-891b98afeb8d]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:55 devstack sudo[93236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD
Aug 04 09:21:55 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:55 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-457937488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d85860c-c809-4509-bab8-b6853b3b6a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e2b709215441a793dcf8e3d00fa2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:21:54Z,use_quota=True,user_id='4b49729593e64978a747b2de42f7a65c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Creating volume 7d85860c-c809-4509-bab8-b6853b3b6a8c {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:21:55 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:21:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:55 devstack sudo[93242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c 1073741824
Aug 04 09:21:55 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:56 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c 1073741824" returned: 0 in 0.518s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:56 devstack sudo[93250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c
Aug 04 09:21:56 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:56 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c" returned: 0 in 0.250s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:21:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:21:56 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Attempting download of 3846a4df-9a56-4b6a-83ff-12d6b09a1144 ((None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}])) to volume 7d85860c-c809-4509-bab8-b6853b3b6a8c. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 04 09:21:56 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[721695ab-3577-45c9-9967-264b16087033]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:21:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_js47p8ee {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:57 devstack sudo[93253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_js47p8ee
Aug 04 09:21:57 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:57 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_js47p8ee" returned: 0 in 0.382s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_js47p8ee {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:57 devstack sudo[93260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_js47p8ee
Aug 04 09:21:57 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:57 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_js47p8ee" returned: 1 in 0.337s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_js47p8ee' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:21:57 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d4412f-0814-4fc6-94a3-ed1a0fbf014d]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:21:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:57 devstack sudo[93272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD
Aug 04 09:21:57 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:21:57 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root
Aug 04 09:21:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:21:57 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] 3846a4df-9a56-4b6a-83ff-12d6b09a1144 was qcow2, converting to raw {{(pid=88880) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 04 09:21:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:21:57 devstack sudo[93277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c
Aug 04 09:21:57 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Acquiring lock "cinder-9c1acf20-acab-494e-9353-4cd0d6487afb-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Lock "cinder-9c1acf20-acab-494e-9353-4cd0d6487afb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:00 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c" returned: 0 in 2.205s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:00 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_ptjmx21gdevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:22:00 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Converted 112.00 MB image at 50.77 MB/s
Aug 04 09:22:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:00 devstack sudo[93290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c 1G
Aug 04 09:22:00 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Acquiring lock "cinder-quobyte-9c1acf20-acab-494e-9353-4cd0d6487afb" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Lock "cinder-quobyte-9c1acf20-acab-494e-9353-4cd0d6487afb" acquired by "delete_volume" :: waited 0.061s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:00 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c2d5e0-c3c0-45ff-ac1b-60c2badcd6eb]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:00 devstack sudo[93328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb
Aug 04 09:22:00 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:00 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c 1G" returned: 0 in 0.543s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:00 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1e8bd1-7126-4e90-bd6b-fc1191a34477]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:01 devstack sudo[93366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c
Aug 04 09:22:01 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:01 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb" returned: 0 in 0.686s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:01 devstack sudo[93411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb
Aug 04 09:22:01 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:01 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c" returned: 0 in 0.572s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:01 devstack sudo[93419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c
Aug 04 09:22:01 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:01 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9c1acf20-acab-494e-9353-4cd0d6487afb" returned: 0 in 0.413s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Lock "cinder-quobyte-9c1acf20-acab-494e-9353-4cd0d6487afb" released by "delete_volume" :: held 1.229s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Created reservations ['e7942b56-d572-4749-99a4-1d86cc8398b0', '659fe16f-4e61-4533-bc15-b1ffab7ea7df', '03319cfb-4f42-4eb9-96de-71d12a69960d', '4fac4722-a84f-4c4c-be1d-fbe82af1087d'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:01 devstack sudo[93430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:22:01 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:01 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c" returned: 1 in 0.414s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Downloaded image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 ((None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}])) to volume 7d85860c-c809-4509-bab8-b6853b3b6a8c successfully. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Temporary image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 for user 4b49729593e64978a747b2de42f7a65c is deleted. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Marking volume 7d85860c-c809-4509-bab8-b6853b3b6a8c as bootable. {{(pid=88880) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Copying metadata from image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 to 7d85860c-c809-4509-bab8-b6853b3b6a8c. {{(pid=88880) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 04 09:22:01 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Creating volume glance metadata for volume 7d85860c-c809-4509-bab8-b6853b3b6a8c backed by image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88880) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 04 09:22:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6d76e0-76cf-455e-84f9-a5d249f66bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d85860c-c809-4509-bab8-b6853b3b6a8c', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba1191c0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0d1b44-5211-448e-b05e-494e0f4dc850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:02 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Volume volume-7d85860c-c809-4509-bab8-b6853b3b6a8c (7d85860c-c809-4509-bab8-b6853b3b6a8c): created successfully
Aug 04 09:22:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0d1b44-5211-448e-b05e-494e0f4dc850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Flow 'volume_create_manager' (43d66fd6-6c9b-4643-92b7-dbe65893aed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:22:02 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-787d7e95-1fbb-480b-a47c-e873b8a0cfe1 tempest-VolumesExtendTest-1164039736 None] Created volume successfully.
Aug 04 09:22:02 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.419s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:02 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:22:02 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Deleted volume successfully.
Aug 04 09:22:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-987cf97d-25e7-4d49-b0c0-20a14238d743 tempest-TaggedAttachmentsTest-1212758924 None] Lock "cinder-9c1acf20-acab-494e-9353-4cd0d6487afb-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-813f0c2e-aefd-4dfb-bb8b-480344a1501f tempest-VolumesExtendTest-1164039736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-813f0c2e-aefd-4dfb-bb8b-480344a1501f tempest-VolumesExtendTest-1164039736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:02 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc48268-0811-42b8-8cee-dfa3469917d5]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-813f0c2e-aefd-4dfb-bb8b-480344a1501f tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:02 devstack sudo[93800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c
Aug 04 09:22:02 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:03 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-813f0c2e-aefd-4dfb-bb8b-480344a1501f tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c" returned: 0 in 0.449s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-813f0c2e-aefd-4dfb-bb8b-480344a1501f tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:03 devstack sudo[93820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c
Aug 04 09:22:03 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:03 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-813f0c2e-aefd-4dfb-bb8b-480344a1501f tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c" returned: 1 in 0.408s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-813f0c2e-aefd-4dfb-bb8b-480344a1501f tempest-VolumesExtendTest-1164039736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:22:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-813f0c2e-aefd-4dfb-bb8b-480344a1501f tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c 2G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-813f0c2e-aefd-4dfb-bb8b-480344a1501f tempest-VolumesExtendTest-1164039736 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c 2G" returned: 0 in 0.130s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-813f0c2e-aefd-4dfb-bb8b-480344a1501f tempest-VolumesExtendTest-1164039736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.112s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:03 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-813f0c2e-aefd-4dfb-bb8b-480344a1501f tempest-VolumesExtendTest-1164039736 None] Extend volume completed successfully.
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Flow 'volume_create_manager' (6110c48b-0f3f-4b94-a160-217558c277b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4c971c-e79b-420c-bb31-c267a0c488b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4c971c-e79b-420c-bb31-c267a0c488b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-138209452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a2c75a-d4f3-4f64-8d76-5f6796c2589f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5687f3d711c44781a3ea1b82b95ce807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:22:04Z,use_quota=True,user_id='e9d3c568c3574169a56118cdb239e742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9087d03-daa2-4a23-8d77-fc1e7fd03450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9087d03-daa2-4a23-8d77-fc1e7fd03450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8143aa6e-eb54-4430-b20a-de94dec19ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8143aa6e-eb54-4430-b20a-de94dec19ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a2c75a-d4f3-4f64-8d76-5f6796c2589f', 'volume_name': 'volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b620c788-06d7-4076-8936-535f35fac504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b620c788-06d7-4076-8936-535f35fac504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790c3607-3975-4ca5-8c7f-3cb3ed40cf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:04 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Volume b7a2c75a-d4f3-4f64-8d76-5f6796c2589f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f', 'volume_size': 1}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-138209452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a2c75a-d4f3-4f64-8d76-5f6796c2589f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5687f3d711c44781a3ea1b82b95ce807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:22:04Z,use_quota=True,user_id='e9d3c568c3574169a56118cdb239e742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Creating volume b7a2c75a-d4f3-4f64-8d76-5f6796c2589f {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:22:04 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:22:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:04 devstack sudo[93845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f 1073741824
Aug 04 09:22:04 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:05 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f 1073741824" returned: 0 in 0.747s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "cinder-7d85860c-c809-4509-bab8-b6853b3b6a8c-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:05 devstack sudo[93854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f
Aug 04 09:22:05 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-7d85860c-c809-4509-bab8-b6853b3b6a8c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "cinder-quobyte-7d85860c-c809-4509-bab8-b6853b3b6a8c" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-quobyte-7d85860c-c809-4509-bab8-b6853b3b6a8c" acquired by "delete_volume" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[395ec174-c10e-465a-82c6-9aaf5f297248]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:05 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f" returned: 0 in 0.385s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:05 devstack sudo[93856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c
Aug 04 09:22:05 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790c3607-3975-4ca5-8c7f-3cb3ed40cf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f686cbec-9d68-4e07-bb15-704f14ed45d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:05 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Volume volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f (b7a2c75a-d4f3-4f64-8d76-5f6796c2589f): created successfully
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f686cbec-9d68-4e07-bb15-704f14ed45d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Flow 'volume_create_manager' (6110c48b-0f3f-4b94-a160-217558c277b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:22:05 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d9f3306e-2f45-4d82-9155-4741d1b102ca tempest-AttachVolumeShelveTestJSON-981222158 None] Created volume successfully.
Aug 04 09:22:05 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c" returned: 0 in 0.479s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:06 devstack sudo[93862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c
Aug 04 09:22:06 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:06 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c" returned: 1 in 0.555s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:22:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:06 devstack sudo[93869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c
Aug 04 09:22:06 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:06 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7d85860c-c809-4509-bab8-b6853b3b6a8c" returned: 0 in 0.367s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-quobyte-7d85860c-c809-4509-bab8-b6853b3b6a8c" released by "delete_volume" :: held 1.496s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:07 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Created reservations ['dd05a9d8-61ea-4b6e-93ad-2d259db7fa9f', 'f5f39227-7541-4484-ab56-0afc27ae7639', 'b192266a-abb7-4200-8640-ca22fea3f8fa', '370ec415-cc85-40d1-aeac-c2112c1ccc44'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:22:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:22:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:22:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:07 devstack sudo[93874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:22:07 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:07 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.377s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:07 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:22:07 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Deleted volume successfully.
Aug 04 09:22:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9316a670-766c-4c15-a731-e78c58bf99f5 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-7d85860c-c809-4509-bab8-b6853b3b6a8c-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:08 devstack sudo[93878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:22:08 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:08 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.534s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Flow 'volume_create_manager' (cf9c6688-114f-4f1a-b98d-492c1b345fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27248034-7e22-4205-b482-14edca39205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27248034-7e22-4205-b482-14edca39205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1355073121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb676e2-cf35-4e68-ad8e-c1478a4a4f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e2b709215441a793dcf8e3d00fa2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:22:09Z,use_quota=True,user_id='4b49729593e64978a747b2de42f7a65c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933d9be3-2f2e-47dd-90b8-2ae86f807cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933d9be3-2f2e-47dd-90b8-2ae86f807cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ef330a-453b-4226-b8ab-9c74fa419598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ef330a-453b-4226-b8ab-9c74fa419598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cb676e2-cf35-4e68-ad8e-c1478a4a4f33', 'volume_name': 'volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea08d17-ca34-4053-9c77-528642933064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea08d17-ca34-4053-9c77-528642933064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb44b631-b696-4ab3-97f5-278e702d59b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:08 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Volume 5cb676e2-cf35-4e68-ad8e-c1478a4a4f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33', 'volume_size': 1}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1355073121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb676e2-cf35-4e68-ad8e-c1478a4a4f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e2b709215441a793dcf8e3d00fa2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:22:09Z,use_quota=True,user_id='4b49729593e64978a747b2de42f7a65c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Creating volume 5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:22:08 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:22:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:08 devstack sudo[93886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 1073741824
Aug 04 09:22:08 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:09 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 1073741824" returned: 0 in 0.673s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:09 devstack sudo[93903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33
Aug 04 09:22:09 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:09 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33" returned: 0 in 0.370s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:22:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb44b631-b696-4ab3-97f5-278e702d59b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfafc35e-65f9-4e2e-bafb-c2db177e44db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:09 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Volume volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 (5cb676e2-cf35-4e68-ad8e-c1478a4a4f33): created successfully
Aug 04 09:22:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfafc35e-65f9-4e2e-bafb-c2db177e44db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Flow 'volume_create_manager' (cf9c6688-114f-4f1a-b98d-492c1b345fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:22:10 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9685fe7b-6bc6-40cf-87bf-0d2cf2f63d71 tempest-VolumesExtendTest-1164039736 None] Created volume successfully.
Aug 04 09:22:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] Creating offline snapshot 2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 of volume 5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:22:11 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ab6de5-b500-483f-ad19-61e3ffb58796]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:11 devstack sudo[93907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33
Aug 04 09:22:11 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:11 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33" returned: 0 in 0.495s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:11 devstack sudo[93912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 1G
Aug 04 09:22:11 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:12 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 1G" returned: 0 in 0.629s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:12 devstack sudo[93918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8
Aug 04 09:22:12 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:12 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8" returned: 0 in 0.479s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:12 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 is being set with open permissions: ugo+rw
Aug 04 09:22:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:12 devstack sudo[93923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8
Aug 04 09:22:12 devstack sudo[93923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:13 devstack sudo[93923]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8" returned: 0 in 0.499s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:13 devstack sudo[93926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.info
Aug 04 09:22:13 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:13 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.info" returned: 0 in 0.361s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:13 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.info is being set with open permissions: ugo+rw
Aug 04 09:22:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:13 devstack sudo[93929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.info
Aug 04 09:22:13 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:14 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.info" returned: 0 in 0.337s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.950s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:14 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4b74be5a-4424-4f34-8dd7-227cbb67fa88 tempest-VolumesExtendTest-1164039736 None] Create snapshot completed successfully
Aug 04 09:22:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ff2b76e1-f608-4faf-8f55-83b9ef653b8e tempest-VolumesExtendTest-1164039736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ff2b76e1-f608-4faf-8f55-83b9ef653b8e tempest-VolumesExtendTest-1164039736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:14 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[21911ab6-f2f7-43aa-9e14-b11f7265724c]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ff2b76e1-f608-4faf-8f55-83b9ef653b8e tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:14 devstack sudo[93934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33
Aug 04 09:22:14 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:15 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ff2b76e1-f608-4faf-8f55-83b9ef653b8e tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33" returned: 0 in 0.534s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ff2b76e1-f608-4faf-8f55-83b9ef653b8e tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 2G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ff2b76e1-f608-4faf-8f55-83b9ef653b8e tempest-VolumesExtendTest-1164039736 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 2G" returned: 0 in 0.187s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ff2b76e1-f608-4faf-8f55-83b9ef653b8e tempest-VolumesExtendTest-1164039736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.786s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:15 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ff2b76e1-f608-4faf-8f55-83b9ef653b8e tempest-VolumesExtendTest-1164039736 None] Extend volume completed successfully.
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "cinder-2fc4670a-0cd6-4f66-9543-4e4da88b4ae8-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-2fc4670a-0cd6-4f66-9543-4e4da88b4ae8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "cinder-quobyte-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-quobyte-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "cinder-quobyte-2fc4670a-0cd6-4f66-9543-4e4da88b4ae8" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-quobyte-2fc4670a-0cd6-4f66-9543-4e4da88b4ae8" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Deleting offline snapshot 2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 of volume 5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] snapshot_file for this snap is: volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb65723-5746-4707-a18c-f652bb3c2146]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:16 devstack sudo[93944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8
Aug 04 09:22:16 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:16 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8" returned: 0 in 0.502s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[784756ac-838d-4bef-bc63-18f9605340a5]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:16 devstack sudo[93959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33
Aug 04 09:22:16 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:17 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33" returned: 0 in 0.627s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:17 devstack sudo[93973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8
Aug 04 09:22:17 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:18 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8" returned: 0 in 0.653s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:18 devstack sudo[93999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8
Aug 04 09:22:18 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:18 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33.2fc4670a-0cd6-4f66-9543-4e4da88b4ae8" returned: 0 in 0.393s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-quobyte-2fc4670a-0cd6-4f66-9543-4e4da88b4ae8" released by "_delete_snapshot" :: held 2.380s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-quobyte-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33" released by "delete_snapshot" :: held 2.419s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:18 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Created reservations ['c282d034-d025-4863-857c-8375d13d1abb', 'fc0bee84-815a-4dd4-99c1-6441a59f37df', '39d03dc7-60ab-4a72-9c77-bf034e0ee64a', 'a6f8113b-93f3-499c-b3df-4b239b5111e6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:22:18 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Delete snapshot completed successfully.
Aug 04 09:22:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f10fa4a6-3a1a-4026-b440-a6aa71ba6b41 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-2fc4670a-0cd6-4f66-9543-4e4da88b4ae8-delete_snapshot" released by "delete_snapshot" :: held 2.613s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-0ec623ca-3268-4fbc-be99-8be4b4539a4d req-1adf9bfd-cd88-43a8-8283-5f49652d23c1 tempest-AttachVolumeShelveTestJSON-981222158 None] No connector for attachment d87286e5-5f35-44a5-bf02-de02f61e4eb7; skipping storage backend terminate_connection call. {{(pid=88880) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Aug 04 09:22:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-0ec623ca-3268-4fbc-be99-8be4b4539a4d req-1adf9bfd-cd88-43a8-8283-5f49652d23c1 tempest-AttachVolumeShelveTestJSON-981222158 None] Deleting attachment d87286e5-5f35-44a5-bf02-de02f61e4eb7. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:22:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "cinder-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "cinder-quobyte-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-quobyte-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:19 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6676d9b0-55c0-4b74-9bb1-bf86017f195f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:19 devstack sudo[94004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33
Aug 04 09:22:19 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:20 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33" returned: 0 in 0.418s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:20 devstack sudo[94011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33
Aug 04 09:22:20 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:20 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33" returned: 0 in 0.310s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-quobyte-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33" released by "delete_volume" :: held 0.817s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Created reservations ['f75c6ebd-9de1-40ad-a997-f6dfb4aba7f7', 'ff5df299-2e2b-4efb-ab8a-f29932c32c6b', 'd4acd668-5fc5-4cfa-a2a1-07ad754f57ef', '93712a41-c6d8-406f-8056-9df39e637e35'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:20 devstack sudo[94015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:22:20 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:20 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.366s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:22:20 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Deleted volume successfully.
Aug 04 09:22:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-58607465-5f9a-4dc5-aff3-7d60e0daf424 tempest-VolumesExtendTest-1164039736 None] Lock "cinder-5cb676e2-cf35-4e68-ad8e-c1478a4a4f33-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:28 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-1df9513c-6dcf-4c8b-a106-9104a3504f3f req-08b555a7-514b-439d-bf60-5d182b786aae tempest-AttachVolumeTestJSON-1848473781 None] Terminate volume connection completed successfully.
Aug 04 09:22:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-1df9513c-6dcf-4c8b-a106-9104a3504f3f req-08b555a7-514b-439d-bf60-5d182b786aae tempest-AttachVolumeTestJSON-1848473781 None] Deleting attachment 73350b03-410a-4182-8356-971ebf6946ec. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Flow 'volume_create_manager' (5ed7f8ff-f9f0-4b38-8175-e348dd825c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c097746c-4641-45cb-8b37-910cf2be35bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c097746c-4641-45cb-8b37-910cf2be35bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1104974200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae9e39f-3d62-4730-9e52-6ad564c604c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a4aa440ca94ea78583ea0be4ea923a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:22:29Z,use_quota=True,user_id='af82689add434db69c2616d755238e0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6094f74a-06d1-4e98-86dc-052e862054a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6094f74a-06d1-4e98-86dc-052e862054a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13dc185d-b455-41df-a336-bcf93fa0c080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13dc185d-b455-41df-a336-bcf93fa0c080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae9e39f-3d62-4730-9e52-6ad564c604c2', 'volume_name': 'volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c282b8ad-546a-438d-8367-8be7a27048a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c282b8ad-546a-438d-8367-8be7a27048a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c41b13-062d-4928-b5fb-506f4e5b5f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:29 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Volume 5ae9e39f-3d62-4730-9e52-6ad564c604c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2', 'volume_size': 1}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1104974200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae9e39f-3d62-4730-9e52-6ad564c604c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a4aa440ca94ea78583ea0be4ea923a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:22:29Z,use_quota=True,user_id='af82689add434db69c2616d755238e0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Creating volume 5ae9e39f-3d62-4730-9e52-6ad564c604c2 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:22:29 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:22:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:29 devstack sudo[94093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2 1073741824
Aug 04 09:22:29 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:30 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2 1073741824" returned: 0 in 0.811s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:30 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=75,cinder:UPDATE=77,cinder:INSERT=19,cinder:DELETE=6 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:22:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:30 devstack sudo[94106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2
Aug 04 09:22:30 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:30 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2" returned: 0 in 0.300s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:22:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c41b13-062d-4928-b5fb-506f4e5b5f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e432e3-5ed5-44c8-9435-d33e58f01b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:22:31 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Volume volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2 (5ae9e39f-3d62-4730-9e52-6ad564c604c2): created successfully
Aug 04 09:22:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e432e3-5ed5-44c8-9435-d33e58f01b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:22:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Flow 'volume_create_manager' (5ed7f8ff-f9f0-4b38-8175-e348dd825c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:22:31 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-08f6f25a-b20c-4f8e-ac27-ad004f6f8f53 tempest-VolumesSnapshotListTestJSON-872080220 None] Created volume successfully.
Aug 04 09:22:32 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=73,cinder:INSERT=26,cinder:UPDATE=77,cinder:DELETE=7 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:22:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] Creating offline snapshot 1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 of volume 5ae9e39f-3d62-4730-9e52-6ad564c604c2 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:22:32 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f08f36-6226-4a87-8500-94bb184ec9f2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:32 devstack sudo[94177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2
Aug 04 09:22:32 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:33 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2" returned: 0 in 0.832s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:33 devstack sudo[94212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 1G
Aug 04 09:22:33 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:33 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 1G" returned: 0 in 0.773s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:34 devstack sudo[94241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5
Aug 04 09:22:34 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:34 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5" returned: 0 in 0.688s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:34 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 is being set with open permissions: ugo+rw
Aug 04 09:22:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:34 devstack sudo[94265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5
Aug 04 09:22:34 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:35 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5" returned: 0 in 0.535s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:35 devstack sudo[94282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.info
Aug 04 09:22:35 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:36 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.info" returned: 0 in 0.726s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:36 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.info is being set with open permissions: ugo+rw
Aug 04 09:22:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:36 devstack sudo[94312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.info
Aug 04 09:22:36 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:36 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.info" returned: 0 in 0.429s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.482s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:36 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a37e7a9a-650d-4778-88d3-6aca1d4cc67c tempest-VolumesSnapshotListTestJSON-872080220 None] Create snapshot completed successfully
Aug 04 09:22:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] Creating offline snapshot 62819b30-ec9b-4168-b084-b9229e49e64f of volume 5ae9e39f-3d62-4730-9e52-6ad564c604c2 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:22:38 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c3f3c2-7235-4031-818b-7ec38e14efb2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:38 devstack sudo[94364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5
Aug 04 09:22:38 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:38 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5" returned: 0 in 0.484s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:22:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:38 devstack sudo[94370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f 1G
Aug 04 09:22:38 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:39 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f 1G" returned: 0 in 0.812s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:39 devstack sudo[94379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f
Aug 04 09:22:39 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:40 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f" returned: 0 in 0.508s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:40 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f is being set with open permissions: ugo+rw
Aug 04 09:22:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:40 devstack sudo[94386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f
Aug 04 09:22:40 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:40 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f" returned: 0 in 0.280s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:40 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-66222356-ba65-4b9a-8264-7147091c9973 tempest-VolumesSnapshotListTestJSON-872080220 None] Create snapshot completed successfully
Aug 04 09:22:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] Creating offline snapshot f1650131-084e-4daf-8d6f-156c5533b2b3 of volume 5ae9e39f-3d62-4730-9e52-6ad564c604c2 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:22:41 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf802505-1262-48a7-8703-f36c3a130927]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:41 devstack sudo[94394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f
Aug 04 09:22:41 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:42 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f" returned: 0 in 0.510s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:22:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:42 devstack sudo[94399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3 1G
Aug 04 09:22:42 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:43 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3 1G" returned: 0 in 0.913s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:43 devstack sudo[94411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3
Aug 04 09:22:43 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:44 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3" returned: 0 in 0.897s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:44 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3 is being set with open permissions: ugo+rw
Aug 04 09:22:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:44 devstack sudo[94438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3
Aug 04 09:22:44 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:44 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3" returned: 0 in 0.551s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.065s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-556a9ec2-8450-4db8-8ae8-b4f42f2411d7 tempest-VolumesSnapshotListTestJSON-872080220 None] Create snapshot completed successfully
Aug 04 09:22:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "cinder-f1650131-084e-4daf-8d6f-156c5533b2b3-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-f1650131-084e-4daf-8d6f-156c5533b2b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "cinder-quobyte-5ae9e39f-3d62-4730-9e52-6ad564c604c2" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-5ae9e39f-3d62-4730-9e52-6ad564c604c2" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "cinder-quobyte-f1650131-084e-4daf-8d6f-156c5533b2b3" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-f1650131-084e-4daf-8d6f-156c5533b2b3" acquired by "_delete_snapshot" :: waited 0.076s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Deleting offline snapshot f1650131-084e-4daf-8d6f-156c5533b2b3 of volume 5ae9e39f-3d62-4730-9e52-6ad564c604c2 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:22:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] snapshot_file for this snap is: volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:22:46 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3dd6d6-6a54-4d4d-a75c-6eb9bed8a902]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:46 devstack sudo[94444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3
Aug 04 09:22:46 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:47 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3" returned: 0 in 0.577s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:22:47 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ee4a77-6fe5-4172-a196-55d4b6579007]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:47 devstack sudo[94452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f
Aug 04 09:22:47 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:48 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f" returned: 0 in 1.130s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:22:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:48 devstack sudo[94487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3
Aug 04 09:22:48 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:49 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3" returned: 0 in 1.446s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:49 devstack sudo[94538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3
Aug 04 09:22:49 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:50 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.f1650131-084e-4daf-8d6f-156c5533b2b3" returned: 0 in 0.419s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-f1650131-084e-4daf-8d6f-156c5533b2b3" released by "_delete_snapshot" :: held 3.760s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-5ae9e39f-3d62-4730-9e52-6ad564c604c2" released by "delete_snapshot" :: held 3.851s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Created reservations ['6e5a08e0-cb14-418a-94c7-aeebaba8c197', '4ff5fd4a-b062-416c-abac-a2aab409625b', '7e6c9e5e-3424-4fe6-8131-86b00842d211', '38e5a5c9-0a89-434b-9da7-a43afdae78be'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:22:50 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Delete snapshot completed successfully.
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6209ac79-84df-459a-b0ce-c40d1d50fbee tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-f1650131-084e-4daf-8d6f-156c5533b2b3-delete_snapshot" released by "delete_snapshot" :: held 4.110s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "cinder-62819b30-ec9b-4168-b084-b9229e49e64f-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-62819b30-ec9b-4168-b084-b9229e49e64f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "cinder-quobyte-5ae9e39f-3d62-4730-9e52-6ad564c604c2" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-5ae9e39f-3d62-4730-9e52-6ad564c604c2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "cinder-quobyte-62819b30-ec9b-4168-b084-b9229e49e64f" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-62819b30-ec9b-4168-b084-b9229e49e64f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Deleting offline snapshot 62819b30-ec9b-4168-b084-b9229e49e64f of volume 5ae9e39f-3d62-4730-9e52-6ad564c604c2 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] snapshot_file for this snap is: volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f74cc97-595f-41f2-96fa-b2af89b96bd4]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:51 devstack sudo[94558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f
Aug 04 09:22:51 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:51 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f" returned: 0 in 0.449s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:22:51 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a912e259-10bc-47d0-a613-9ce1c122d906]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:51 devstack sudo[94575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5
Aug 04 09:22:51 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:52 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5" returned: 0 in 0.579s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:52 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:22:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:52 devstack sudo[94580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f
Aug 04 09:22:52 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:52 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f" returned: 0 in 0.396s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:52 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f
Aug 04 09:22:52 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:52 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.62819b30-ec9b-4168-b084-b9229e49e64f" returned: 0 in 0.292s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-62819b30-ec9b-4168-b084-b9229e49e64f" released by "_delete_snapshot" :: held 1.849s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-5ae9e39f-3d62-4730-9e52-6ad564c604c2" released by "delete_snapshot" :: held 1.877s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:52 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Created reservations ['1bd85583-ffa6-49b8-8b25-63cd423b4556', '72e9cd54-4f59-4534-ae05-051df43da94d', '6c2d4c6b-f33f-4c7c-a519-38a407253944', '3cc891ff-cf27-4f8f-8140-305a00d10fb2'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:22:52 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Delete snapshot completed successfully.
Aug 04 09:22:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1fc28c82-f566-4ace-9b74-7a3c17d10a3a tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-62819b30-ec9b-4168-b084-b9229e49e64f-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "cinder-1e3cf528-fdf0-4f0d-a657-d04ba7213dc5-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-1e3cf528-fdf0-4f0d-a657-d04ba7213dc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "cinder-quobyte-5ae9e39f-3d62-4730-9e52-6ad564c604c2" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-5ae9e39f-3d62-4730-9e52-6ad564c604c2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "cinder-quobyte-1e3cf528-fdf0-4f0d-a657-d04ba7213dc5" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-1e3cf528-fdf0-4f0d-a657-d04ba7213dc5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Deleting offline snapshot 1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 of volume 5ae9e39f-3d62-4730-9e52-6ad564c604c2 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] snapshot_file for this snap is: volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bbb81d-f4be-4735-96a5-1026a35c0e49]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:53 devstack sudo[94591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5
Aug 04 09:22:53 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:53 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5" returned: 0 in 0.510s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ad3326-1638-4c0f-8e5f-4de43d98e231]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:53 devstack sudo[94596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2
Aug 04 09:22:53 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:54 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2" returned: 0 in 0.445s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:54 devstack sudo[94601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5
Aug 04 09:22:54 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:54 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5" returned: 0 in 0.429s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:54 devstack sudo[94607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5
Aug 04 09:22:54 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:54 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2.1e3cf528-fdf0-4f0d-a657-d04ba7213dc5" returned: 0 in 0.272s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-1e3cf528-fdf0-4f0d-a657-d04ba7213dc5" released by "_delete_snapshot" :: held 1.811s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-5ae9e39f-3d62-4730-9e52-6ad564c604c2" released by "delete_snapshot" :: held 1.849s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:55 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Created reservations ['9441da7e-a146-4339-94eb-ea4d291bbe10', '17006439-45fa-409e-8e93-0dd50783e1ea', '1ae463bb-5c5f-4c41-801b-beb234a1d2ef', '1dde1db1-7fed-45c6-a845-946412b5f169'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:22:55 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Delete snapshot completed successfully.
Aug 04 09:22:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eff48c30-439d-4889-a66d-681d6ff5fb6c tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-1e3cf528-fdf0-4f0d-a657-d04ba7213dc5-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "cinder-5ae9e39f-3d62-4730-9e52-6ad564c604c2-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-5ae9e39f-3d62-4730-9e52-6ad564c604c2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "cinder-quobyte-5ae9e39f-3d62-4730-9e52-6ad564c604c2" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:22:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-5ae9e39f-3d62-4730-9e52-6ad564c604c2" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:22:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa8ce1f-992f-4af7-b3fa-0130104462e1]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:22:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:55 devstack sudo[94611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2
Aug 04 09:22:55 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:56 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2" returned: 0 in 0.392s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:56 devstack sudo[94616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2
Aug 04 09:22:56 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:56 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ae9e39f-3d62-4730-9e52-6ad564c604c2" returned: 0 in 0.270s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-quobyte-5ae9e39f-3d62-4730-9e52-6ad564c604c2" released by "delete_volume" :: held 0.730s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Created reservations ['88751e76-16eb-4a1a-aadb-0d3404ca64b6', '9f236f86-bf15-4aea-b807-aa81738e16b2', '736336c5-061d-47ec-a05a-791de80b5a52', '23c288db-94c7-4305-a7f0-fb9cd0f5ad56'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:22:56 devstack sudo[94619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:22:56 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:22:56 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.315s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:22:56 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Deleted volume successfully.
Aug 04 09:22:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b5fff2fe-0941-4320-819e-ad94183e084e tempest-VolumesSnapshotListTestJSON-872080220 None] Lock "cinder-5ae9e39f-3d62-4730-9e52-6ad564c604c2-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:23:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Acquiring lock "cinder-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:23:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Lock "cinder-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:23:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Acquiring lock "cinder-quobyte-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:23:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Lock "cinder-quobyte-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:23:05 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[301d9cce-c933-41b0-a958-c1c39db89073]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:23:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:05 devstack sudo[94683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f
Aug 04 09:23:05 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:05 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f" returned: 0 in 0.493s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:05 devstack sudo[94688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f
Aug 04 09:23:05 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:05 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f" returned: 0 in 0.414s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Lock "cinder-quobyte-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f" released by "delete_volume" :: held 0.989s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:23:06 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Created reservations ['c1c7d98a-4b50-48dd-a803-93f6cf723b86', '1a55bb68-1958-47cc-8eb4-a4246a15c90e', 'ddeb0188-409a-40a0-94a9-314ca662abb9', '361818c0-f519-4b23-bd3e-3e8274c3982a'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:23:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:23:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:23:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:06 devstack sudo[94692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:23:06 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:06 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.323s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:06 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:23:06 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Deleted volume successfully.
Aug 04 09:23:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f797f5ec-5293-4a63-b8fe-f81f3d479756 tempest-AttachVolumeShelveTestJSON-981222158 None] Lock "cinder-b7a2c75a-d4f3-4f64-8d76-5f6796c2589f-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:23:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:23:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:23:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:23:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:08 devstack sudo[94729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:23:08 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:08 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.298s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:23:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:23:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:23:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:23:16 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=34,cinder:SELECT=34,cinder:DELETE=1,cinder:INSERT=8 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:23:16 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=31,cinder:UPDATE=40,cinder:INSERT=13,cinder:DELETE=4 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Flow 'volume_create_manager' (fe5188f2-c325-4f01-a50f-b581381d824c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0b2816-07ae-462a-aeb9-c2420446a63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0b2816-07ae-462a-aeb9-c2420446a63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1191092515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6985265-129e-435f-b4b1-097b39621fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e7a5c915314317803c6f1e4d7ff505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:18Z,use_quota=True,user_id='564b59b983834ef096cdc9e95051af94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7222061-5b28-4c2d-b407-0cab0d246150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7222061-5b28-4c2d-b407-0cab0d246150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956b0c55-af3b-430a-b780-9c230f996bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956b0c55-af3b-430a-b780-9c230f996bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6985265-129e-435f-b4b1-097b39621fb7', 'volume_name': 'volume-f6985265-129e-435f-b4b1-097b39621fb7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d8ec4b-659f-4068-b3f6-ba6f8698edb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d8ec4b-659f-4068-b3f6-ba6f8698edb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8337e34-58d7-4dd3-999d-b45737f34d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:18 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Volume f6985265-129e-435f-b4b1-097b39621fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6985265-129e-435f-b4b1-097b39621fb7', 'volume_size': 1}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1191092515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6985265-129e-435f-b4b1-097b39621fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e7a5c915314317803c6f1e4d7ff505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:18Z,use_quota=True,user_id='564b59b983834ef096cdc9e95051af94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Creating volume f6985265-129e-435f-b4b1-097b39621fb7 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:23:18 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:18 devstack sudo[94756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7 1073741824
Aug 04 09:23:18 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Flow 'volume_create_manager' (0fd06302-c9ec-4906-8aa9-1f536a91a8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0104b773-feaf-4c19-9bdf-46d855836447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0104b773-feaf-4c19-9bdf-46d855836447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-652143538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c2f0da-b520-40c0-a161-02367422329e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5849844c8dc4e73bc8e880bfa4f3741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:19Z,use_quota=True,user_id='bde3096fdc8e4368a70067b739551000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b783340a-a1f0-4e38-9bbc-837f077029fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b783340a-a1f0-4e38-9bbc-837f077029fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490b87e3-39bc-4f98-825f-7850f99dd356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490b87e3-39bc-4f98-825f-7850f99dd356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c2f0da-b520-40c0-a161-02367422329e', 'volume_name': 'volume-d0c2f0da-b520-40c0-a161-02367422329e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7cc776-00c8-4e22-aa0d-ceb589fd738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7cc776-00c8-4e22-aa0d-ceb589fd738e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (028dc7e0-391d-461e-be53-3a1f6088769a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:18 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Volume d0c2f0da-b520-40c0-a161-02367422329e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c2f0da-b520-40c0-a161-02367422329e', 'volume_size': 1}
Aug 04 09:23:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:19 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7 1073741824" returned: 0 in 0.573s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:19 devstack sudo[94764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7
Aug 04 09:23:19 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:19 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7" returned: 0 in 0.289s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-652143538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c2f0da-b520-40c0-a161-02367422329e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5849844c8dc4e73bc8e880bfa4f3741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:19Z,use_quota=True,user_id='bde3096fdc8e4368a70067b739551000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Creating volume d0c2f0da-b520-40c0-a161-02367422329e {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:23:19 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8337e34-58d7-4dd3-999d-b45737f34d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6985265-129e-435f-b4b1-097b39621fb7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75a906b-0f41-4117-8f3e-a028ff088eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:19 devstack sudo[94767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e 1073741824
Aug 04 09:23:19 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:19 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Volume volume-f6985265-129e-435f-b4b1-097b39621fb7 (f6985265-129e-435f-b4b1-097b39621fb7): created successfully
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75a906b-0f41-4117-8f3e-a028ff088eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Flow 'volume_create_manager' (fe5188f2-c325-4f01-a50f-b581381d824c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:19 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e8078336-2efb-41f7-b9b1-2d1639f5b060 tempest-ServerActionsTestOtherA-2089351963 None] Created volume successfully.
Aug 04 09:23:20 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e 1073741824" returned: 0 in 0.586s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:20 devstack sudo[94774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e
Aug 04 09:23:20 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:20 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e" returned: 0 in 0.286s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:23:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (028dc7e0-391d-461e-be53-3a1f6088769a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c2f0da-b520-40c0-a161-02367422329e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc378e4-57ce-46ef-828f-0ec13280539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:20 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Volume volume-d0c2f0da-b520-40c0-a161-02367422329e (d0c2f0da-b520-40c0-a161-02367422329e): created successfully
Aug 04 09:23:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc378e4-57ce-46ef-828f-0ec13280539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Flow 'volume_create_manager' (0fd06302-c9ec-4906-8aa9-1f536a91a8fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:20 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-3dcf5f11-1091-4563-b44f-eb15fdcfc4ca req-7cdbe29d-b252-49ef-8acb-a7ac3c4fda35 tempest-VolumesSnapshotsTestJSON-532714182 None] Created volume successfully.
Aug 04 09:23:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] Creating offline snapshot ecc5e411-24d6-46e6-a767-6a1e91f93815 of volume d0c2f0da-b520-40c0-a161-02367422329e {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:23:21 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a8925a-7287-422f-9e9c-dbfff27bfe4d]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:23:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:21 devstack sudo[94777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e
Aug 04 09:23:21 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:21 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e" returned: 0 in 0.440s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:21 devstack sudo[94782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815 1G
Aug 04 09:23:21 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:22 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815 1G" returned: 0 in 0.690s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c2f0da-b520-40c0-a161-02367422329e -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:22 devstack sudo[94803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c2f0da-b520-40c0-a161-02367422329e -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815
Aug 04 09:23:22 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:23 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c2f0da-b520-40c0-a161-02367422329e -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815" returned: 0 in 0.634s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:23 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815 is being set with open permissions: ugo+rw
Aug 04 09:23:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:23 devstack sudo[94843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815
Aug 04 09:23:23 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:23 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815" returned: 0 in 0.350s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:23 devstack sudo[94861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.info
Aug 04 09:23:23 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:24 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.info" returned: 0 in 0.545s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:24 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.info is being set with open permissions: ugo+rw
Aug 04 09:23:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:24 devstack sudo[94883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.info
Aug 04 09:23:24 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:24 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.info" returned: 0 in 0.474s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.289s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:24 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-e6094f06-56cc-40d7-99cf-642ef40599d7 req-ed100097-80c5-41b1-b733-bed4d77664d3 tempest-VolumesSnapshotsTestJSON-532714182 None] Create snapshot completed successfully
Aug 04 09:23:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Acquiring lock "cinder-ecc5e411-24d6-46e6-a767-6a1e91f93815-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:23:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "cinder-ecc5e411-24d6-46e6-a767-6a1e91f93815-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:23:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Acquiring lock "cinder-quobyte-d0c2f0da-b520-40c0-a161-02367422329e" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:23:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "cinder-quobyte-d0c2f0da-b520-40c0-a161-02367422329e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:23:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Acquiring lock "cinder-quobyte-ecc5e411-24d6-46e6-a767-6a1e91f93815" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:23:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "cinder-quobyte-ecc5e411-24d6-46e6-a767-6a1e91f93815" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:23:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Deleting offline snapshot ecc5e411-24d6-46e6-a767-6a1e91f93815 of volume d0c2f0da-b520-40c0-a161-02367422329e {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:23:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] snapshot_file for this snap is: volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:23:25 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[129ea293-5509-4f61-a9b3-2e3f98f9b6d6]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:23:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:25 devstack sudo[94889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815
Aug 04 09:23:25 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:26 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815" returned: 0 in 0.920s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:26 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0c2f0da-b520-40c0-a161-02367422329e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:23:26 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab50db4f-0282-40f2-9110-8115f4638b1e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:23:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:26 devstack sudo[94897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e
Aug 04 09:23:26 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:27 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e" returned: 0 in 0.916s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:27 devstack sudo[94906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815
Aug 04 09:23:27 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:27 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815" returned: 0 in 0.664s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:27 devstack sudo[94921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815
Aug 04 09:23:27 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:28 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e.ecc5e411-24d6-46e6-a767-6a1e91f93815" returned: 0 in 0.434s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:28 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "cinder-quobyte-ecc5e411-24d6-46e6-a767-6a1e91f93815" released by "_delete_snapshot" :: held 3.126s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:23:28 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "cinder-quobyte-d0c2f0da-b520-40c0-a161-02367422329e" released by "delete_snapshot" :: held 3.165s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:23:28 devstack cinder-volume[88880]: DEBUG cinder.quota [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Created reservations ['dd72f675-b7c7-4f6f-b21a-830906e7cf40', '94895536-3f0f-4286-86d0-489e74530362', '2cce1e67-2bd4-4623-baf6-40b33db02eb8', 'd0cb43ae-42bd-48eb-b181-ea772bda10ce'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:23:28 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Delete snapshot completed successfully.
Aug 04 09:23:28 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-7afed62d-c003-4437-8257-c8f029b0085b req-c5e50ea8-1071-42e7-a6f6-578e5c7f2338 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "cinder-ecc5e411-24d6-46e6-a767-6a1e91f93815-delete_snapshot" released by "delete_snapshot" :: held 3.405s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:23:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Acquiring lock "cinder-d0c2f0da-b520-40c0-a161-02367422329e-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:23:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "cinder-d0c2f0da-b520-40c0-a161-02367422329e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:23:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Acquiring lock "cinder-quobyte-d0c2f0da-b520-40c0-a161-02367422329e" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:23:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "cinder-quobyte-d0c2f0da-b520-40c0-a161-02367422329e" acquired by "delete_volume" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:23:29 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f8dce8-ff45-45ed-b585-edb636dcf15e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:23:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:30 devstack sudo[94930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e
Aug 04 09:23:30 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:30 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e" returned: 0 in 0.456s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:30 devstack sudo[94935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e
Aug 04 09:23:30 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:30 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d0c2f0da-b520-40c0-a161-02367422329e" returned: 0 in 0.417s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "cinder-quobyte-d0c2f0da-b520-40c0-a161-02367422329e" released by "delete_volume" :: held 1.013s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:23:30 devstack cinder-volume[88880]: DEBUG cinder.quota [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Created reservations ['678eab62-0bbb-4980-a526-3ae026a7b969', '88abbf13-df61-4203-a13c-52f9de03cef2', 'a7ff1110-1172-4fe2-b4bb-85871762285d', '8bd8935b-e151-4a73-bddb-11ac3906786b'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:23:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:23:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:23:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:31 devstack sudo[94938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:23:31 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:31 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.478s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:31 devstack cinder-volume[88880]: DEBUG cinder.manager [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:23:31 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Deleted volume successfully.
Aug 04 09:23:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-db59cbc0-d034-44d6-922b-87e1a88dfd80 req-6128e056-0fea-466a-a271-83716358d018 tempest-VolumesSnapshotsTestJSON-532714182 None] Lock "cinder-d0c2f0da-b520-40c0-a161-02367422329e-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Flow 'volume_create_manager' (33cf57b4-2e0c-440c-87f1-3b780396cbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f64dcf-470f-42f8-971d-aded25073bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f64dcf-470f-42f8-971d-aded25073bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1414106032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c65f469-f4b4-4390-b9f1-5bffbe01d5ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de677a0eb28248b487bd7880174cd357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:39Z,use_quota=True,user_id='52228c2056a64ea294c495cb14d90d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ba0ff4-08e2-4ea4-98ae-c08ab1e7e08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ba0ff4-08e2-4ea4-98ae-c08ab1e7e08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df19d9a4-fd77-4fb3-88e3-5b77993b49bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df19d9a4-fd77-4fb3-88e3-5b77993b49bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c65f469-f4b4-4390-b9f1-5bffbe01d5ed', 'volume_name': 'volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422fbba9-f62d-437c-a53c-0f37c516316a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422fbba9-f62d-437c-a53c-0f37c516316a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4604b73b-68ac-4e1f-90e2-3c4ca6e65d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:39 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Volume 7c65f469-f4b4-4390-b9f1-5bffbe01d5ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed', 'volume_size': 1}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1414106032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c65f469-f4b4-4390-b9f1-5bffbe01d5ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='de677a0eb28248b487bd7880174cd357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:39Z,use_quota=True,user_id='52228c2056a64ea294c495cb14d90d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Creating volume 7c65f469-f4b4-4390-b9f1-5bffbe01d5ed {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:23:39 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:23:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:39 devstack sudo[95072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed 1073741824
Aug 04 09:23:39 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:40 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed 1073741824" returned: 0 in 0.669s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:40 devstack sudo[95079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed
Aug 04 09:23:40 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:40 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed" returned: 0 in 0.419s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:23:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4604b73b-68ac-4e1f-90e2-3c4ca6e65d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b5d59f-ef42-4796-afec-503ab772f2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:40 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Volume volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed (7c65f469-f4b4-4390-b9f1-5bffbe01d5ed): created successfully
Aug 04 09:23:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b5d59f-ef42-4796-afec-503ab772f2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Flow 'volume_create_manager' (33cf57b4-2e0c-440c-87f1-3b780396cbd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:40 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-989853e2-dbeb-404f-b929-292c259ec072 req-291faf04-2d78-464d-9e5f-f8cd5e1dc9a2 tempest-VolumesGetTestJSON-464797554 None] Created volume successfully.
Aug 04 09:23:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Acquiring lock "cinder-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:23:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Lock "cinder-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:23:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Acquiring lock "cinder-quobyte-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:23:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Lock "cinder-quobyte-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed" acquired by "delete_volume" :: waited 0.030s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:23:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842d4d9-5de2-4af9-b897-70c0d9c53a6e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:23:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:42 devstack sudo[95098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed
Aug 04 09:23:42 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:42 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed" returned: 0 in 0.591s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:42 devstack sudo[95106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed
Aug 04 09:23:42 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:43 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed" returned: 0 in 0.485s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Lock "cinder-quobyte-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed" released by "delete_volume" :: held 1.189s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:23:43 devstack cinder-volume[88880]: DEBUG cinder.quota [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Created reservations ['914a22bf-4852-40a0-8f3c-5cf9274e2bb0', 'de4b7b94-e2d2-4f38-81c5-6b129e6906b9', 'a8be20b7-75eb-42cf-8927-d1909f97e3de', '715d86e9-c168-473d-a44a-a0abc86bb8a9'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:23:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:23:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:23:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:43 devstack sudo[95122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:23:43 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:44 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.541s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:44 devstack cinder-volume[88880]: DEBUG cinder.manager [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:23:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Deleted volume successfully.
Aug 04 09:23:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-5c70bcae-8e23-495a-8763-e6ddb015a009 req-23be9104-c207-4592-8f3d-6f88a6c2f181 tempest-VolumesGetTestJSON-464797554 None] Lock "cinder-7c65f469-f4b4-4390-b9f1-5bffbe01d5ed-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Flow 'volume_create_manager' (44c3fd76-c1c2-4206-8ab0-8c2d202466be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152d028d-b495-462c-8f32-955d186e0da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152d028d-b495-462c-8f32-955d186e0da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-71065064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a114e7-4b2c-4af5-bb18-6130b41ab1b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bb5c1f5ed1343e7a5eaad2b864f7c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:51Z,use_quota=True,user_id='3cd6938fd3224d52a21c5c79a025b9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc8593d-3b8a-4841-8ed7-7ba26ebe125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc8593d-3b8a-4841-8ed7-7ba26ebe125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40de2f63-50c9-4017-989b-72645110681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40de2f63-50c9-4017-989b-72645110681f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a114e7-4b2c-4af5-bb18-6130b41ab1b3', 'volume_name': 'volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a64225f-a1de-4cc5-9708-83dde40363f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a64225f-a1de-4cc5-9708-83dde40363f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f319dbff-031b-49b1-bc87-756ab38b80ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:51 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Volume a9a114e7-4b2c-4af5-bb18-6130b41ab1b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3', 'volume_size': 1}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-71065064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a114e7-4b2c-4af5-bb18-6130b41ab1b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bb5c1f5ed1343e7a5eaad2b864f7c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:51Z,use_quota=True,user_id='3cd6938fd3224d52a21c5c79a025b9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Creating volume a9a114e7-4b2c-4af5-bb18-6130b41ab1b3 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:23:51 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:51 devstack sudo[95222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3 1073741824
Aug 04 09:23:51 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:51 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3 1073741824" returned: 0 in 0.770s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:52 devstack sudo[95238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3
Aug 04 09:23:52 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:52 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3" returned: 0 in 0.415s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f319dbff-031b-49b1-bc87-756ab38b80ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd1fbc0-b9b4-485a-b323-c725423b92de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:52 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Volume volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3 (a9a114e7-4b2c-4af5-bb18-6130b41ab1b3): created successfully
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd1fbc0-b9b4-485a-b323-c725423b92de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Flow 'volume_create_manager' (44c3fd76-c1c2-4206-8ab0-8c2d202466be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:52 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-8cc580ae-4199-4c51-b2af-5fe895a07fed tempest-VolumesTestJSON-541761992 None] Created volume successfully.
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Flow 'volume_create_manager' (d8be4deb-c46c-48af-b947-6537ce51d46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1e7a53-3438-4ec1-a649-4412fa3a56bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1e7a53-3438-4ec1-a649-4412fa3a56bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-113623417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68a6db7-5f73-4f6d-9e56-f6090dedb925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd2d535b9f4e15adeacc81d312b555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:53Z,use_quota=True,user_id='e957010905464eb9916ae755ac1b7ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9a6a62-0292-4831-82c7-e6d0acb106fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9a6a62-0292-4831-82c7-e6d0acb106fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c9b3cb-e7e5-455e-bda4-3f6ae4c7a261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c9b3cb-e7e5-455e-bda4-3f6ae4c7a261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68a6db7-5f73-4f6d-9e56-f6090dedb925', 'volume_name': 'volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57e9512-ef3e-4cd9-9d77-c78a5babf5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57e9512-ef3e-4cd9-9d77-c78a5babf5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b775f9a6-a964-4d5a-80d4-a53a28e611e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:52 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Volume f68a6db7-5f73-4f6d-9e56-f6090dedb925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925', 'volume_size': 1}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-113623417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68a6db7-5f73-4f6d-9e56-f6090dedb925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd2d535b9f4e15adeacc81d312b555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:53Z,use_quota=True,user_id='e957010905464eb9916ae755ac1b7ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Creating volume f68a6db7-5f73-4f6d-9e56-f6090dedb925 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:23:52 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:23:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:52 devstack sudo[95241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925 1073741824
Aug 04 09:23:52 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:53 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925 1073741824" returned: 0 in 0.575s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:53 devstack sudo[95247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925
Aug 04 09:23:53 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:53 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925" returned: 0 in 0.337s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b775f9a6-a964-4d5a-80d4-a53a28e611e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25cd3eb-84b3-48b8-8164-184c24a2932e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:53 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Volume volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925 (f68a6db7-5f73-4f6d-9e56-f6090dedb925): created successfully
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25cd3eb-84b3-48b8-8164-184c24a2932e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Flow 'volume_create_manager' (d8be4deb-c46c-48af-b947-6537ce51d46e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:53 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b554e4c4-2ff9-4e8c-88d7-d1f7d518d173 tempest-AttachVolumeTestJSON-1848473781 None] Created volume successfully.
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Flow 'volume_create_manager' (4951dcca-4e1f-4f04-9765-0ae04711fe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9650f499-7019-482e-9c51-585996017a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9650f499-7019-482e-9c51-585996017a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1564440766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2974dced-6bb2-4276-b3bc-cb6f093c82a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bb5c1f5ed1343e7a5eaad2b864f7c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:54Z,use_quota=True,user_id='3cd6938fd3224d52a21c5c79a025b9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd8421b-3e5f-44d2-9faf-a0da3f5728a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd8421b-3e5f-44d2-9faf-a0da3f5728a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349424d8-4e27-4505-a8bf-56e058a31b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349424d8-4e27-4505-a8bf-56e058a31b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2974dced-6bb2-4276-b3bc-cb6f093c82a2', 'volume_name': 'volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74fce80-2c41-4863-b391-0a2b87131033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74fce80-2c41-4863-b391-0a2b87131033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f0ba33-8215-4139-9b1c-0cb7f4467101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:54 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Volume 2974dced-6bb2-4276-b3bc-cb6f093c82a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2', 'volume_size': 1}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1564440766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2974dced-6bb2-4276-b3bc-cb6f093c82a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bb5c1f5ed1343e7a5eaad2b864f7c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:54Z,use_quota=True,user_id='3cd6938fd3224d52a21c5c79a025b9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Creating volume 2974dced-6bb2-4276-b3bc-cb6f093c82a2 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:23:54 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:54 devstack sudo[95252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2 1073741824
Aug 04 09:23:54 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:54 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2 1073741824" returned: 0 in 0.441s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:54 devstack sudo[95281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2
Aug 04 09:23:54 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:54 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2" returned: 0 in 0.346s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f0ba33-8215-4139-9b1c-0cb7f4467101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa3e31c-b028-4d19-a51c-3f665037bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:54 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Volume volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2 (2974dced-6bb2-4276-b3bc-cb6f093c82a2): created successfully
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa3e31c-b028-4d19-a51c-3f665037bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Flow 'volume_create_manager' (4951dcca-4e1f-4f04-9765-0ae04711fe4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:54 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4c18d86c-b2a7-4762-94cc-126d3596eb53 tempest-VolumesTestJSON-541761992 None] Created volume successfully.
Aug 04 09:23:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-696b9568-8b9c-4c41-be03-0f12c11a5bcb req-465ee92a-8033-4ea5-8f5b-8d5c07dee7e7 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-696b9568-8b9c-4c41-be03-0f12c11a5bcb req-465ee92a-8033-4ea5-8f5b-8d5c07dee7e7 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a970d30-38ac-46f8-aa91-f9e728e3d8f4]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:23:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-696b9568-8b9c-4c41-be03-0f12c11a5bcb req-465ee92a-8033-4ea5-8f5b-8d5c07dee7e7 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:55 devstack sudo[95297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925
Aug 04 09:23:55 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:55 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-696b9568-8b9c-4c41-be03-0f12c11a5bcb req-465ee92a-8033-4ea5-8f5b-8d5c07dee7e7 tempest-AttachVolumeTestJSON-1848473781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925" returned: 0 in 0.370s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-696b9568-8b9c-4c41-be03-0f12c11a5bcb req-465ee92a-8033-4ea5-8f5b-8d5c07dee7e7 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.387s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-696b9568-8b9c-4c41-be03-0f12c11a5bcb req-465ee92a-8033-4ea5-8f5b-8d5c07dee7e7 tempest-AttachVolumeTestJSON-1848473781 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6240e142-2b72-4076-b3b1-d39564c2a148', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:23:55 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-696b9568-8b9c-4c41-be03-0f12c11a5bcb req-465ee92a-8033-4ea5-8f5b-8d5c07dee7e7 tempest-AttachVolumeTestJSON-1848473781 None] attachment_update completed successfully.
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Flow 'volume_create_manager' (00240cfb-9aca-45e0-8d12-727e8f2973d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1804566-05a3-4c87-9b7f-a2280202efd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1804566-05a3-4c87-9b7f-a2280202efd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-357120157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2a5523-415d-4526-9112-9daa06a17b33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bb5c1f5ed1343e7a5eaad2b864f7c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:57Z,use_quota=True,user_id='3cd6938fd3224d52a21c5c79a025b9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b78394-6b31-4e3b-b1a7-9cee3cd6a491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b78394-6b31-4e3b-b1a7-9cee3cd6a491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943f17bd-5a9d-468d-8504-886e978333f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943f17bd-5a9d-468d-8504-886e978333f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c2a5523-415d-4526-9112-9daa06a17b33', 'volume_name': 'volume-5c2a5523-415d-4526-9112-9daa06a17b33', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b17933-7cee-4010-990d-f58a27219272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b17933-7cee-4010-990d-f58a27219272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c708ba8-8dec-41c6-bffb-6d6c2fdbfd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:56 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Volume 5c2a5523-415d-4526-9112-9daa06a17b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c2a5523-415d-4526-9112-9daa06a17b33', 'volume_size': 1}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-357120157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2a5523-415d-4526-9112-9daa06a17b33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bb5c1f5ed1343e7a5eaad2b864f7c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:57Z,use_quota=True,user_id='3cd6938fd3224d52a21c5c79a025b9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Creating volume 5c2a5523-415d-4526-9112-9daa06a17b33 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:23:56 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:23:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c2a5523-415d-4526-9112-9daa06a17b33 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:56 devstack sudo[95687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c2a5523-415d-4526-9112-9daa06a17b33 1073741824
Aug 04 09:23:56 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:57 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c2a5523-415d-4526-9112-9daa06a17b33 1073741824" returned: 0 in 0.464s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c2a5523-415d-4526-9112-9daa06a17b33 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:57 devstack sudo[95692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c2a5523-415d-4526-9112-9daa06a17b33
Aug 04 09:23:57 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:57 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c2a5523-415d-4526-9112-9daa06a17b33" returned: 0 in 0.242s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:23:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c708ba8-8dec-41c6-bffb-6d6c2fdbfd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2a5523-415d-4526-9112-9daa06a17b33', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cbcc0ba-7eab-4f3e-83e5-ad33857175d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:57 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Volume volume-5c2a5523-415d-4526-9112-9daa06a17b33 (5c2a5523-415d-4526-9112-9daa06a17b33): created successfully
Aug 04 09:23:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cbcc0ba-7eab-4f3e-83e5-ad33857175d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Flow 'volume_create_manager' (00240cfb-9aca-45e0-8d12-727e8f2973d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:57 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-85d39895-4144-4ae4-843e-091537364f7a tempest-VolumesTestJSON-541761992 None] Created volume successfully.
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Flow 'volume_create_manager' (a7bcb169-a2b1-4c70-9a93-3864271fa376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6abd89b-188c-4386-8c46-0b86dc963f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6abd89b-188c-4386-8c46-0b86dc963f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1362393770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2129176-8f09-4cff-8c49-4d30fd864422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd2d535b9f4e15adeacc81d312b555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:58Z,use_quota=True,user_id='e957010905464eb9916ae755ac1b7ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f4addc-65e7-48fc-b854-98b42e9679c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f4addc-65e7-48fc-b854-98b42e9679c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26b1cec-bc01-4c72-b265-316e0e20c83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26b1cec-bc01-4c72-b265-316e0e20c83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2129176-8f09-4cff-8c49-4d30fd864422', 'volume_name': 'volume-d2129176-8f09-4cff-8c49-4d30fd864422', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39316779-4bd5-4d3f-9d44-fce3bd8e3b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39316779-4bd5-4d3f-9d44-fce3bd8e3b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d585f3-280c-40c1-b10d-77fb224b5fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:58 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Volume d2129176-8f09-4cff-8c49-4d30fd864422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2129176-8f09-4cff-8c49-4d30fd864422', 'volume_size': 1}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1362393770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2129176-8f09-4cff-8c49-4d30fd864422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bd2d535b9f4e15adeacc81d312b555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:23:58Z,use_quota=True,user_id='e957010905464eb9916ae755ac1b7ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Creating volume d2129176-8f09-4cff-8c49-4d30fd864422 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:23:58 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:58 devstack sudo[95695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422 1073741824
Aug 04 09:23:58 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:58 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422 1073741824" returned: 0 in 0.387s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:23:58 devstack sudo[95700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422
Aug 04 09:23:58 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:23:58 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422" returned: 0 in 0.288s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d585f3-280c-40c1-b10d-77fb224b5fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2129176-8f09-4cff-8c49-4d30fd864422', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b0e231-7d48-42fe-8830-a197e8b4acb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:23:58 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Volume volume-d2129176-8f09-4cff-8c49-4d30fd864422 (d2129176-8f09-4cff-8c49-4d30fd864422): created successfully
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b0e231-7d48-42fe-8830-a197e8b4acb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:23:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Flow 'volume_create_manager' (a7bcb169-a2b1-4c70-9a93-3864271fa376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:23:58 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d405686b-b489-4038-8114-9fd2ba533a01 tempest-AttachVolumeTestJSON-1848473781 None] Created volume successfully.
Aug 04 09:23:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Acquiring lock "cinder-5c2a5523-415d-4526-9112-9daa06a17b33-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:23:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Lock "cinder-5c2a5523-415d-4526-9112-9daa06a17b33-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:23:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Acquiring lock "cinder-quobyte-5c2a5523-415d-4526-9112-9daa06a17b33" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:23:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Lock "cinder-quobyte-5c2a5523-415d-4526-9112-9daa06a17b33" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:23:59 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee974e9d-591e-4164-9491-56bdde5de386]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:23:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c2a5523-415d-4526-9112-9daa06a17b33 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-3bba6b15-e411-420c-a6f9-786e2f061f56 req-0974b574-aecb-4cdd-b641-de4510a2d44a tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-3bba6b15-e411-420c-a6f9-786e2f061f56 req-0974b574-aecb-4cdd-b641-de4510a2d44a tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[52418ba0-95e2-4747-aef5-36beed094388]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-3bba6b15-e411-420c-a6f9-786e2f061f56 req-0974b574-aecb-4cdd-b641-de4510a2d44a tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:00 devstack sudo[95717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c2a5523-415d-4526-9112-9daa06a17b33
Aug 04 09:24:00 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:00 devstack sudo[95718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422
Aug 04 09:24:00 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:00 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c2a5523-415d-4526-9112-9daa06a17b33" returned: 0 in 0.475s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c2a5523-415d-4526-9112-9daa06a17b33 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:00 devstack sudo[95725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c2a5523-415d-4526-9112-9daa06a17b33
Aug 04 09:24:00 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:00 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-3bba6b15-e411-420c-a6f9-786e2f061f56 req-0974b574-aecb-4cdd-b641-de4510a2d44a tempest-AttachVolumeTestJSON-1848473781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422" returned: 0 in 0.497s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-3bba6b15-e411-420c-a6f9-786e2f061f56 req-0974b574-aecb-4cdd-b641-de4510a2d44a tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.521s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-3bba6b15-e411-420c-a6f9-786e2f061f56 req-0974b574-aecb-4cdd-b641-de4510a2d44a tempest-AttachVolumeTestJSON-1848473781 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-d2129176-8f09-4cff-8c49-4d30fd864422', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3eba970b-4335-4e0f-a50a-f1d644baa554', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:24:00 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-3bba6b15-e411-420c-a6f9-786e2f061f56 req-0974b574-aecb-4cdd-b641-de4510a2d44a tempest-AttachVolumeTestJSON-1848473781 None] attachment_update completed successfully.
Aug 04 09:24:00 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c2a5523-415d-4526-9112-9daa06a17b33" returned: 0 in 0.356s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Lock "cinder-quobyte-5c2a5523-415d-4526-9112-9daa06a17b33" released by "delete_volume" :: held 0.888s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Created reservations ['5e1cd628-187c-4804-b6bc-7f2248c92a44', 'f06f8501-d3b5-4f37-8cfd-d32e2a12655d', '7cde856b-9bd3-4a51-9546-44ab242efcc2', 'a975eea1-d0a2-47d0-b6a2-1e4d05f4e6c8'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:01 devstack sudo[95736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:24:01 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Acquiring lock "cinder-2974dced-6bb2-4276-b3bc-cb6f093c82a2-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Lock "cinder-2974dced-6bb2-4276-b3bc-cb6f093c82a2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Acquiring lock "cinder-quobyte-2974dced-6bb2-4276-b3bc-cb6f093c82a2" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Lock "cinder-quobyte-2974dced-6bb2-4276-b3bc-cb6f093c82a2" acquired by "delete_volume" :: waited 0.033s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:01 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcff1b2-6819-4231-9d74-6b5608f191fa]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:01 devstack sudo[95739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2
Aug 04 09:24:01 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:01 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.533s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:01 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:24:01 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Deleted volume successfully.
Aug 04 09:24:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a450b477-951c-499c-94f8-26038714e95d tempest-VolumesTestJSON-541761992 None] Lock "cinder-5c2a5523-415d-4526-9112-9daa06a17b33-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:01 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2" returned: 0 in 0.637s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:01 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2
Aug 04 09:24:01 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:02 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2974dced-6bb2-4276-b3bc-cb6f093c82a2" returned: 0 in 0.283s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Lock "cinder-quobyte-2974dced-6bb2-4276-b3bc-cb6f093c82a2" released by "delete_volume" :: held 0.980s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:02 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Created reservations ['38de043e-6df9-4027-8344-5ae9d176f249', '2ae1fc74-cc05-4933-a1ff-33d35b389dff', 'c8020b3f-1d35-4d27-86e7-4e69886a9d9c', '76441ff4-aba6-46ae-928b-0aa6a6df0da7'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:02 devstack sudo[95772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:24:02 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:02 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.314s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:02 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:24:02 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Deleted volume successfully.
Aug 04 09:24:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f52a0b0e-44ec-4c3a-8d44-fc9f84d485f9 tempest-VolumesTestJSON-541761992 None] Lock "cinder-2974dced-6bb2-4276-b3bc-cb6f093c82a2-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:03 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-d1ce0412-da9d-4763-a2fc-6fffaa615989 req-10119597-73ba-4224-a86a-7043869be755 tempest-AttachVolumeTestJSON-1848473781 None] Terminate volume connection completed successfully.
Aug 04 09:24:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-d1ce0412-da9d-4763-a2fc-6fffaa615989 req-10119597-73ba-4224-a86a-7043869be755 tempest-AttachVolumeTestJSON-1848473781 None] Deleting attachment 6240e142-2b72-4076-b3b1-d39564c2a148. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:24:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Acquiring lock "cinder-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Lock "cinder-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Acquiring lock "cinder-quobyte-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Lock "cinder-quobyte-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3" acquired by "delete_volume" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:03 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[64745198-8edd-4dc6-93ce-cc8405bc15f2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:03 devstack sudo[95795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3
Aug 04 09:24:03 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:04 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3" returned: 0 in 0.427s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:04 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3
Aug 04 09:24:04 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:04 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3" returned: 0 in 0.304s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Lock "cinder-quobyte-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3" released by "delete_volume" :: held 0.790s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Created reservations ['965402ab-bfb1-4b7e-9412-b27fbda57619', 'ae3f3d92-e063-4c98-b292-ecc34a7d61dd', 'caf2885e-7163-44ad-b69a-e74b30936795', '542a6e2a-4842-4c87-8810-ab2873a0760e'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:04 devstack sudo[95818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:24:04 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:04 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-05b5c8c5-52b5-4950-90d7-9965ee278a4f req-9e41d9b2-e8c4-46b9-832e-e36d2d9dbc5b tempest-AttachVolumeTestJSON-1848473781 None] Terminate volume connection completed successfully.
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-05b5c8c5-52b5-4950-90d7-9965ee278a4f req-9e41d9b2-e8c4-46b9-832e-e36d2d9dbc5b tempest-AttachVolumeTestJSON-1848473781 None] Deleting attachment 3eba970b-4335-4e0f-a50a-f1d644baa554. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-a63c89d1-917e-4d2b-92f5-814b6262a1a4 req-7890a7a6-10e9-4a6e-aa84-82f04ed9ddde tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-a63c89d1-917e-4d2b-92f5-814b6262a1a4 req-7890a7a6-10e9-4a6e-aa84-82f04ed9ddde tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3356a0e9-4884-4cfa-b044-50c0504690df]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-a63c89d1-917e-4d2b-92f5-814b6262a1a4 req-7890a7a6-10e9-4a6e-aa84-82f04ed9ddde tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:04 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.334s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:04 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:24:04 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Deleted volume successfully.
Aug 04 09:24:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e16a9024-26b7-4b70-9675-5145fce098f6 tempest-VolumesTestJSON-541761992 None] Lock "cinder-a9a114e7-4b2c-4af5-bb18-6130b41ab1b3-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:05 devstack sudo[95849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7
Aug 04 09:24:05 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:05 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-a63c89d1-917e-4d2b-92f5-814b6262a1a4 req-7890a7a6-10e9-4a6e-aa84-82f04ed9ddde tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7" returned: 0 in 0.428s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-a63c89d1-917e-4d2b-92f5-814b6262a1a4 req-7890a7a6-10e9-4a6e-aa84-82f04ed9ddde tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.453s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-a63c89d1-917e-4d2b-92f5-814b6262a1a4 req-7890a7a6-10e9-4a6e-aa84-82f04ed9ddde tempest-ServerActionsTestOtherA-2089351963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-f6985265-129e-435f-b4b1-097b39621fb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60bfc8e1-aeb5-46e1-a366-583d5a675eea', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:24:05 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-a63c89d1-917e-4d2b-92f5-814b6262a1a4 req-7890a7a6-10e9-4a6e-aa84-82f04ed9ddde tempest-ServerActionsTestOtherA-2089351963 None] attachment_update completed successfully.
Aug 04 09:24:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:24:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:08 devstack sudo[96268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:24:08 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:08 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.366s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:24:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:24:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:24:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:24:09 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-edcde014-0e68-4f1c-9f62-9ba771c02064 req-70d66b5a-4fe2-42a8-9db8-2c4c376ade10 tempest-ServerActionsTestOtherA-2089351963 None] Terminate volume connection completed successfully.
Aug 04 09:24:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-edcde014-0e68-4f1c-9f62-9ba771c02064 req-70d66b5a-4fe2-42a8-9db8-2c4c376ade10 tempest-ServerActionsTestOtherA-2089351963 None] Deleting attachment 60bfc8e1-aeb5-46e1-a366-583d5a675eea. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:24:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-866a26b4-d2a5-4267-9e96-fee2a81b02b7 tempest-BackendsCapabilitiesAdminTestsJSON-1579878551 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576637268066, 'free_capacity_gb': 1775.7576637268066, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88880) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 04 09:24:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c7b38b6-0f3b-4699-a3c0-7f7d389b190a tempest-BackendsCapabilitiesAdminTestsJSON-1579878551 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576637268066, 'free_capacity_gb': 1775.7576637268066, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88880) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 04 09:24:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "cinder-d2129176-8f09-4cff-8c49-4d30fd864422-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Lock "cinder-d2129176-8f09-4cff-8c49-4d30fd864422-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "cinder-quobyte-d2129176-8f09-4cff-8c49-4d30fd864422" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Lock "cinder-quobyte-d2129176-8f09-4cff-8c49-4d30fd864422" acquired by "delete_volume" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:10 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf023a-147d-4cee-babc-421c27a260ec]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-edcde014-0e68-4f1c-9f62-9ba771c02064 req-89c87efb-2b90-43d7-8fbc-a10c1ad75111 tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-edcde014-0e68-4f1c-9f62-9ba771c02064 req-89c87efb-2b90-43d7-8fbc-a10c1ad75111 tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:10 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2e7efd-0d79-446e-96af-de4c14ae2698]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-edcde014-0e68-4f1c-9f62-9ba771c02064 req-89c87efb-2b90-43d7-8fbc-a10c1ad75111 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:10 devstack sudo[96334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422
Aug 04 09:24:10 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:11 devstack sudo[96335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7
Aug 04 09:24:11 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:11 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422" returned: 0 in 0.469s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:11 devstack sudo[96343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422
Aug 04 09:24:11 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:11 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-edcde014-0e68-4f1c-9f62-9ba771c02064 req-89c87efb-2b90-43d7-8fbc-a10c1ad75111 tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7" returned: 0 in 0.571s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-edcde014-0e68-4f1c-9f62-9ba771c02064 req-89c87efb-2b90-43d7-8fbc-a10c1ad75111 tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.599s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-edcde014-0e68-4f1c-9f62-9ba771c02064 req-89c87efb-2b90-43d7-8fbc-a10c1ad75111 tempest-ServerActionsTestOtherA-2089351963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-f6985265-129e-435f-b4b1-097b39621fb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '552ab4fc-77b0-4692-87d9-0b058c59483a', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:24:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-edcde014-0e68-4f1c-9f62-9ba771c02064 req-89c87efb-2b90-43d7-8fbc-a10c1ad75111 tempest-ServerActionsTestOtherA-2089351963 None] attachment_update completed successfully.
Aug 04 09:24:11 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d2129176-8f09-4cff-8c49-4d30fd864422" returned: 0 in 0.382s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Lock "cinder-quobyte-d2129176-8f09-4cff-8c49-4d30fd864422" released by "delete_volume" :: held 0.939s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Created reservations ['60e92d98-9e89-44b3-899b-757d2643833a', 'ccf7adcc-b1f6-4ed2-a752-8b6166c7f29a', 'b4c841b8-5b45-441d-b552-387ca0f51932', 'a40322f9-dde6-42b3-bdec-f588964f9f1f'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:11 devstack sudo[96351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:24:11 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "cinder-f68a6db7-5f73-4f6d-9e56-f6090dedb925-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Lock "cinder-f68a6db7-5f73-4f6d-9e56-f6090dedb925-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "cinder-quobyte-f68a6db7-5f73-4f6d-9e56-f6090dedb925" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Lock "cinder-quobyte-f68a6db7-5f73-4f6d-9e56-f6090dedb925" acquired by "delete_volume" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:12 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[02369095-06a4-45e9-ad44-fb743eb0a144]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:12 devstack sudo[96357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925
Aug 04 09:24:12 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:12 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.542s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:12 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:24:12 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Deleted volume successfully.
Aug 04 09:24:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-83e5bf69-6b2f-4110-95c6-0be375f10938 tempest-AttachVolumeTestJSON-1848473781 None] Lock "cinder-d2129176-8f09-4cff-8c49-4d30fd864422-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:12 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925" returned: 0 in 0.540s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:12 devstack sudo[96378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925
Aug 04 09:24:12 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:13 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f68a6db7-5f73-4f6d-9e56-f6090dedb925" returned: 0 in 0.387s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Lock "cinder-quobyte-f68a6db7-5f73-4f6d-9e56-f6090dedb925" released by "delete_volume" :: held 1.005s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Created reservations ['0d61fdc4-4717-4b96-a09a-cbd49138b16f', 'a01c5185-2554-4983-8cbb-afcf72cb98ff', '20095fa5-8273-4ad0-9055-c4a6201b4c49', 'f9b84f6e-c7b0-4d5c-866a-f201d12aa89d'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:13 devstack sudo[96462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:24:13 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Flow 'volume_create_manager' (efcd9d18-c4b1-4e79-9ff4-e5df7ddb4d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c9c442-5361-47d7-9937-ce45702c2163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c9c442-5361-47d7-9937-ce45702c2163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1561789170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b66d941-8663-4075-b1ff-b1cd03f67712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33312f20574418ca70f891d4042cb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:24:14Z,use_quota=True,user_id='94e88d90c8894403bf150e956712cf12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ca8187-472a-4664-af1c-d647328ed061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ca8187-472a-4664-af1c-d647328ed061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83e504c-ede7-47ff-8826-b7855a63ca13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83e504c-ede7-47ff-8826-b7855a63ca13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b66d941-8663-4075-b1ff-b1cd03f67712', 'volume_name': 'volume-2b66d941-8663-4075-b1ff-b1cd03f67712', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e1e8cc-2264-4ff6-b2ab-c23f2afb98d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e1e8cc-2264-4ff6-b2ab-c23f2afb98d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a203b1b-e679-4d45-a59f-51d805281529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:13 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Volume 2b66d941-8663-4075-b1ff-b1cd03f67712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b66d941-8663-4075-b1ff-b1cd03f67712', 'volume_size': 1}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1561789170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b66d941-8663-4075-b1ff-b1cd03f67712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33312f20574418ca70f891d4042cb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:24:14Z,use_quota=True,user_id='94e88d90c8894403bf150e956712cf12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Creating volume 2b66d941-8663-4075-b1ff-b1cd03f67712 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:24:13 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:13 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.344s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:24:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Deleted volume successfully.
Aug 04 09:24:13 devstack sudo[96786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712 1073741824
Aug 04 09:24:13 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bcbf2e1-3323-40ed-ac86-0ff1b8bd6a18 tempest-AttachVolumeTestJSON-1848473781 None] Lock "cinder-f68a6db7-5f73-4f6d-9e56-f6090dedb925-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:14 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712 1073741824" returned: 0 in 0.663s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:14 devstack sudo[96803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712
Aug 04 09:24:14 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "cinder-afb527ed-578e-4bff-9575-f7faa9366e69-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Lock "cinder-afb527ed-578e-4bff-9575-f7faa9366e69-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "cinder-quobyte-afb527ed-578e-4bff-9575-f7faa9366e69" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Lock "cinder-quobyte-afb527ed-578e-4bff-9575-f7faa9366e69" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:14 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2722a75-522e-468d-81a8-03d76bc9520c]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:14 devstack sudo[96813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69
Aug 04 09:24:14 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:14 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712" returned: 0 in 0.412s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:24:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a203b1b-e679-4d45-a59f-51d805281529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b66d941-8663-4075-b1ff-b1cd03f67712', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d14b7e73-62ad-4b82-a3c3-e0c7b1744445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:15 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Volume volume-2b66d941-8663-4075-b1ff-b1cd03f67712 (2b66d941-8663-4075-b1ff-b1cd03f67712): created successfully
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d14b7e73-62ad-4b82-a3c3-e0c7b1744445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Flow 'volume_create_manager' (efcd9d18-c4b1-4e79-9ff4-e5df7ddb4d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:24:15 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4dab07ec-fc8c-44f7-9d57-f0f8974f9b54 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Created volume successfully.
Aug 04 09:24:15 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69" returned: 0 in 0.453s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:15 devstack sudo[96834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69
Aug 04 09:24:15 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:15 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-afb527ed-578e-4bff-9575-f7faa9366e69" returned: 0 in 0.295s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Lock "cinder-quobyte-afb527ed-578e-4bff-9575-f7faa9366e69" released by "delete_volume" :: held 0.796s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Created reservations ['065f8fe9-1e17-4f07-a31d-e4c1f9afb746', 'f6c40d20-36d3-41b6-ab46-7ff7409876ea', '2e0fad88-cd7f-493e-9247-f858e6c5c971', 'cd739ab6-4b4a-4cef-91fe-ed1290806d64'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:15 devstack sudo[96837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:24:15 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:16 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.504s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:16 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:24:16 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Deleted volume successfully.
Aug 04 09:24:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-420857d1-7db8-404a-b775-ce2247116aff tempest-AttachVolumeTestJSON-1848473781 None] Lock "cinder-afb527ed-578e-4bff-9575-f7faa9366e69-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:17 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=92,cinder:UPDATE=103,cinder:INSERT=26,cinder:DELETE=9 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:24:17 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=95,cinder:UPDATE=106,cinder:DELETE=9,cinder:INSERT=20 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:24:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-0f43a1a1-1644-4da4-aac0-35b7d834d2a6 req-66c7d19a-fd7f-41fc-af5d-0ad047b222ab tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-0f43a1a1-1644-4da4-aac0-35b7d834d2a6 req-66c7d19a-fd7f-41fc-af5d-0ad047b222ab tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:17 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c9c5b3-5e9f-4171-9042-a15a6f26c83c]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-0f43a1a1-1644-4da4-aac0-35b7d834d2a6 req-66c7d19a-fd7f-41fc-af5d-0ad047b222ab tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:17 devstack sudo[96855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712
Aug 04 09:24:17 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:18 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-0f43a1a1-1644-4da4-aac0-35b7d834d2a6 req-66c7d19a-fd7f-41fc-af5d-0ad047b222ab tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712" returned: 0 in 0.611s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-0f43a1a1-1644-4da4-aac0-35b7d834d2a6 req-66c7d19a-fd7f-41fc-af5d-0ad047b222ab tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.684s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-0f43a1a1-1644-4da4-aac0-35b7d834d2a6 req-66c7d19a-fd7f-41fc-af5d-0ad047b222ab tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-2b66d941-8663-4075-b1ff-b1cd03f67712', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '018483e2-eb2b-4d02-a093-0881871a2034', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:24:18 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-0f43a1a1-1644-4da4-aac0-35b7d834d2a6 req-66c7d19a-fd7f-41fc-af5d-0ad047b222ab tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] attachment_update completed successfully.
Aug 04 09:24:23 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-d43a55f0-612c-4a89-ade3-54e746b519ce req-257b11b6-3061-4034-a087-758a4afca8cb tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Terminate volume connection completed successfully.
Aug 04 09:24:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-d43a55f0-612c-4a89-ade3-54e746b519ce req-257b11b6-3061-4034-a087-758a4afca8cb tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Deleting attachment 018483e2-eb2b-4d02-a093-0881871a2034. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:24:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Acquiring lock "cinder-2b66d941-8663-4075-b1ff-b1cd03f67712-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Lock "cinder-2b66d941-8663-4075-b1ff-b1cd03f67712-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Acquiring lock "cinder-quobyte-2b66d941-8663-4075-b1ff-b1cd03f67712" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Lock "cinder-quobyte-2b66d941-8663-4075-b1ff-b1cd03f67712" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:24 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db944ec-526b-426a-a071-b923824c15c8]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:24 devstack sudo[96874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712
Aug 04 09:24:24 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:24 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712" returned: 0 in 0.566s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:24 devstack sudo[96880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712
Aug 04 09:24:24 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:24 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b66d941-8663-4075-b1ff-b1cd03f67712" returned: 0 in 0.292s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Lock "cinder-quobyte-2b66d941-8663-4075-b1ff-b1cd03f67712" released by "delete_volume" :: held 0.926s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:25 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Created reservations ['8e491c86-1e5f-48ee-b33e-8da890bb9202', 'fb448abd-c7c6-4c1c-bd61-0d35d10f7676', '471d19cf-89a8-494c-bb10-603e42a5e779', '8823e43b-3814-4c0d-ab32-c7acfab6f4af'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:25 devstack sudo[96884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:24:25 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:25 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.309s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:25 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:24:25 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Deleted volume successfully.
Aug 04 09:24:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7ab85b4c-3ff6-467e-9ab7-7348da1dea02 tempest-TestServerVolumeAttachScenarioOldVersion-205045896 None] Lock "cinder-2b66d941-8663-4075-b1ff-b1cd03f67712-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:27 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-58a4102d-5d33-4226-9288-9f61b9ab6544 tempest-GroupsTest-589152492 None] Group tempest-Group1-11339726: creating
Aug 04 09:24:27 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-58a4102d-5d33-4226-9288-9f61b9ab6544 tempest-GroupsTest-589152492 None] Group tempest-Group1-11339726: created successfully
Aug 04 09:24:27 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-58a4102d-5d33-4226-9288-9f61b9ab6544 tempest-GroupsTest-589152492 None] Create group completed successfully.
Aug 04 09:24:29 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-84f2c5df-550a-467d-a19b-77a0fea4d67a tempest-GroupsTest-589152492 None] Group tempest-Group2-1479055234: creating
Aug 04 09:24:29 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-84f2c5df-550a-467d-a19b-77a0fea4d67a tempest-GroupsTest-589152492 None] Group tempest-Group2-1479055234: created successfully
Aug 04 09:24:29 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-84f2c5df-550a-467d-a19b-77a0fea4d67a tempest-GroupsTest-589152492 None] Create group completed successfully.
Aug 04 09:24:30 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:24:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Flow 'volume_create_manager' (7f5fdd05-9ee8-4c7a-bd4f-3e2069b6c5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:24:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7f2767-45f3-400d-a760-185ef16f5938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7f2767-45f3-400d-a760-185ef16f5938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1704002987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0f290423-2475-4ea3-a4d6-bb512ae52939,host='devstack@QuobyteHD#QuobyteHD',id=317c39ab-5e99-4f58-b80d-a38aae5a7187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6627377f1b9428d9b8b232af6e0c702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:24:31Z,use_quota=True,user_id='67418a33d5604ae2ba198e1b0f3e2abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3a323df-de37-4fa3-b8ed-6ddcbfd27fcd),volume_type_id=e3a323df-de37-4fa3-b8ed-6ddcbfd27fcd)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03128fc1-400b-4366-8d97-e3b631473fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03128fc1-400b-4366-8d97-e3b631473fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190fdae5-6388-49be-a8af-4fb3082e9bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190fdae5-6388-49be-a8af-4fb3082e9bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317c39ab-5e99-4f58-b80d-a38aae5a7187', 'volume_name': 'volume-317c39ab-5e99-4f58-b80d-a38aae5a7187', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6effe8-54ec-41a2-8e6f-d31964c0d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6effe8-54ec-41a2-8e6f-d31964c0d449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3be12fe-d903-436a-98b6-e26e6ecb55f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:31 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Volume 317c39ab-5e99-4f58-b80d-a38aae5a7187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317c39ab-5e99-4f58-b80d-a38aae5a7187', 'volume_size': 1}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0f290423-2475-4ea3-a4d6-bb512ae52939,created_at=2026-08-04T07:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1704002987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0f290423-2475-4ea3-a4d6-bb512ae52939,host='devstack@QuobyteHD#QuobyteHD',id=317c39ab-5e99-4f58-b80d-a38aae5a7187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6627377f1b9428d9b8b232af6e0c702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:24:31Z,use_quota=True,user_id='67418a33d5604ae2ba198e1b0f3e2abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3a323df-de37-4fa3-b8ed-6ddcbfd27fcd),volume_type_id=e3a323df-de37-4fa3-b8ed-6ddcbfd27fcd)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Creating volume 317c39ab-5e99-4f58-b80d-a38aae5a7187 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:24:31 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-317c39ab-5e99-4f58-b80d-a38aae5a7187 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:31 devstack sudo[96941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-317c39ab-5e99-4f58-b80d-a38aae5a7187 1073741824
Aug 04 09:24:31 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:31 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-317c39ab-5e99-4f58-b80d-a38aae5a7187 1073741824" returned: 0 in 0.587s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-317c39ab-5e99-4f58-b80d-a38aae5a7187 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:31 devstack sudo[96947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-317c39ab-5e99-4f58-b80d-a38aae5a7187
Aug 04 09:24:31 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:31 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-317c39ab-5e99-4f58-b80d-a38aae5a7187" returned: 0 in 0.289s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3be12fe-d903-436a-98b6-e26e6ecb55f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317c39ab-5e99-4f58-b80d-a38aae5a7187', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0cca01-f3ac-443f-9cf1-c0c853b92230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:32 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Volume volume-317c39ab-5e99-4f58-b80d-a38aae5a7187 (317c39ab-5e99-4f58-b80d-a38aae5a7187): created successfully
Aug 04 09:24:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0cca01-f3ac-443f-9cf1-c0c853b92230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Flow 'volume_create_manager' (7f5fdd05-9ee8-4c7a-bd4f-3e2069b6c5f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:24:32 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b9a9c19d-8357-47df-959a-d49f2303abae tempest-GroupsTest-589152492 None] Created volume successfully.
Aug 04 09:24:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Acquiring lock "cinder-quobyte-317c39ab-5e99-4f58-b80d-a38aae5a7187" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Lock "cinder-quobyte-317c39ab-5e99-4f58-b80d-a38aae5a7187" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:33 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50bb286-459b-4215-9df6-e3eb3c0cf380]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-317c39ab-5e99-4f58-b80d-a38aae5a7187 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:33 devstack sudo[96975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-317c39ab-5e99-4f58-b80d-a38aae5a7187
Aug 04 09:24:33 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:34 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-317c39ab-5e99-4f58-b80d-a38aae5a7187" returned: 0 in 0.496s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-317c39ab-5e99-4f58-b80d-a38aae5a7187 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:34 devstack sudo[97014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-317c39ab-5e99-4f58-b80d-a38aae5a7187
Aug 04 09:24:34 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:34 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-317c39ab-5e99-4f58-b80d-a38aae5a7187" returned: 0 in 0.351s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Lock "cinder-quobyte-317c39ab-5e99-4f58-b80d-a38aae5a7187" released by "delete_volume" :: held 0.902s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:34 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Created reservations ['dad40886-f031-4f9a-b7ee-f09ae6a837b2'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:34 devstack cinder-volume[88880]: WARNING cinder.quota [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-439818786 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-439818786, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:24:34 devstack cinder-volume[88880]: WARNING cinder.quota [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-439818786 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-439818786, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:24:34 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Created reservations ['b13d13f7-dc8c-4a6e-8272-c3b364521e44', '5ea82b41-8cf1-41b5-aa99-8f9a8b64f79f', '07652a49-2bb5-49bd-acb2-6d006561c438', '290dd9f7-df4e-4272-a102-a29025e9de16'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:35 devstack sudo[97019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:24:35 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:35 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-bebf8159-1377-46ad-b5f7-1a83007864d8 tempest-GroupsTest-589152492 None] Created reservations ['f4a8e081-d7c8-439e-a8fd-4b9d34372418'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bebf8159-1377-46ad-b5f7-1a83007864d8 tempest-GroupsTest-589152492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bebf8159-1377-46ad-b5f7-1a83007864d8 tempest-GroupsTest-589152492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bebf8159-1377-46ad-b5f7-1a83007864d8 tempest-GroupsTest-589152492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bebf8159-1377-46ad-b5f7-1a83007864d8 tempest-GroupsTest-589152492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bebf8159-1377-46ad-b5f7-1a83007864d8 tempest-GroupsTest-589152492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bebf8159-1377-46ad-b5f7-1a83007864d8 tempest-GroupsTest-589152492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:35 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.402s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:35 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:24:35 devstack sudo[97022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:24:35 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:35 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-c789159d-b466-4de2-b82b-301eff05491d tempest-GroupsTest-589152492 None] Delete group completed successfully.
Aug 04 09:24:35 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bebf8159-1377-46ad-b5f7-1a83007864d8 tempest-GroupsTest-589152492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.377s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:35 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-bebf8159-1377-46ad-b5f7-1a83007864d8 tempest-GroupsTest-589152492 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:24:35 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-bebf8159-1377-46ad-b5f7-1a83007864d8 tempest-GroupsTest-589152492 None] Delete group completed successfully.
Aug 04 09:24:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-7374f370-3a82-49ac-8560-e1dd510e56a9 tempest-GroupsTest-589152492 None] Group tempest-GroupsTest-Group-1441771779: creating
Aug 04 09:24:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-7374f370-3a82-49ac-8560-e1dd510e56a9 tempest-GroupsTest-589152492 None] Group tempest-GroupsTest-Group-1441771779: created successfully
Aug 04 09:24:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-7374f370-3a82-49ac-8560-e1dd510e56a9 tempest-GroupsTest-589152492 None] Create group completed successfully.
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Flow 'volume_create_manager' (d15cee50-20fe-4487-9221-c9c85a4242b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2c4f44-dd65-42bf-918a-9ed7539c847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2c4f44-dd65-42bf-918a-9ed7539c847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-437084324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=62bd0a01-2cec-428e-bc9d-424da07d29ba,host='devstack@QuobyteHD#QuobyteHD',id=80c9b741-74fc-4237-b88b-a742e9870aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6627377f1b9428d9b8b232af6e0c702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:24:39Z,use_quota=True,user_id='67418a33d5604ae2ba198e1b0f3e2abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1be66fda-f3a1-4093-b418-6265e9af1ffa),volume_type_id=1be66fda-f3a1-4093-b418-6265e9af1ffa)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5420b2-2b83-403c-96f1-ca962b608b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5420b2-2b83-403c-96f1-ca962b608b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c695a867-981a-4049-bf80-909a885ba80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c695a867-981a-4049-bf80-909a885ba80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c9b741-74fc-4237-b88b-a742e9870aba', 'volume_name': 'volume-80c9b741-74fc-4237-b88b-a742e9870aba', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded17a4a-c623-4dfc-8b87-b29658ff77e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded17a4a-c623-4dfc-8b87-b29658ff77e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68df300-2ca6-4102-81b2-3ef336300720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:38 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Volume 80c9b741-74fc-4237-b88b-a742e9870aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c9b741-74fc-4237-b88b-a742e9870aba', 'volume_size': 1}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=62bd0a01-2cec-428e-bc9d-424da07d29ba,created_at=2026-08-04T07:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-437084324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=62bd0a01-2cec-428e-bc9d-424da07d29ba,host='devstack@QuobyteHD#QuobyteHD',id=80c9b741-74fc-4237-b88b-a742e9870aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6627377f1b9428d9b8b232af6e0c702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:24:39Z,use_quota=True,user_id='67418a33d5604ae2ba198e1b0f3e2abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1be66fda-f3a1-4093-b418-6265e9af1ffa),volume_type_id=1be66fda-f3a1-4093-b418-6265e9af1ffa)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Creating volume 80c9b741-74fc-4237-b88b-a742e9870aba {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:24:38 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:24:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-80c9b741-74fc-4237-b88b-a742e9870aba 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:39 devstack sudo[97027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-80c9b741-74fc-4237-b88b-a742e9870aba 1073741824
Aug 04 09:24:39 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:39 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-80c9b741-74fc-4237-b88b-a742e9870aba 1073741824" returned: 0 in 0.570s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-80c9b741-74fc-4237-b88b-a742e9870aba {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:39 devstack sudo[97034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-80c9b741-74fc-4237-b88b-a742e9870aba
Aug 04 09:24:39 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:40 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-80c9b741-74fc-4237-b88b-a742e9870aba" returned: 0 in 0.389s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:24:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68df300-2ca6-4102-81b2-3ef336300720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c9b741-74fc-4237-b88b-a742e9870aba', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913d70dc-bd03-4254-9875-9e175b4f8fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:40 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Volume volume-80c9b741-74fc-4237-b88b-a742e9870aba (80c9b741-74fc-4237-b88b-a742e9870aba): created successfully
Aug 04 09:24:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913d70dc-bd03-4254-9875-9e175b4f8fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Flow 'volume_create_manager' (d15cee50-20fe-4487-9221-c9c85a4242b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:24:40 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4b5ecf96-e863-42c5-a11c-0c8604e0f0b7 tempest-GroupsTest-589152492 None] Created volume successfully.
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Flow 'volume_create_manager' (8ec9e75a-9fdb-410b-9712-89b6f8874bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18903f15-a071-4956-8921-ff0eaf7cbdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18903f15-a071-4956-8921-ff0eaf7cbdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-822372733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=62bd0a01-2cec-428e-bc9d-424da07d29ba,host='devstack@QuobyteHD#QuobyteHD',id=d594f0f2-a1a4-49b2-b77a-8b3ee3679f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6627377f1b9428d9b8b232af6e0c702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:24:42Z,use_quota=True,user_id='67418a33d5604ae2ba198e1b0f3e2abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1be66fda-f3a1-4093-b418-6265e9af1ffa),volume_type_id=1be66fda-f3a1-4093-b418-6265e9af1ffa)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93f267a-347c-444c-b2f2-7f183e85b030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93f267a-347c-444c-b2f2-7f183e85b030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21997786-9d99-4a63-a248-accfe55c220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21997786-9d99-4a63-a248-accfe55c220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd594f0f2-a1a4-49b2-b77a-8b3ee3679f90', 'volume_name': 'volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b905fa-551f-4161-b7d0-644eb720a94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b905fa-551f-4161-b7d0-644eb720a94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2746d66-679a-4d2e-8274-6c3927260d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:42 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Volume d594f0f2-a1a4-49b2-b77a-8b3ee3679f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90', 'volume_size': 1}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=62bd0a01-2cec-428e-bc9d-424da07d29ba,created_at=2026-08-04T07:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-822372733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=62bd0a01-2cec-428e-bc9d-424da07d29ba,host='devstack@QuobyteHD#QuobyteHD',id=d594f0f2-a1a4-49b2-b77a-8b3ee3679f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6627377f1b9428d9b8b232af6e0c702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:24:42Z,use_quota=True,user_id='67418a33d5604ae2ba198e1b0f3e2abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1be66fda-f3a1-4093-b418-6265e9af1ffa),volume_type_id=1be66fda-f3a1-4093-b418-6265e9af1ffa)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Creating volume d594f0f2-a1a4-49b2-b77a-8b3ee3679f90 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:24:42 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:24:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:42 devstack sudo[97040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90 1073741824
Aug 04 09:24:42 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:43 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90 1073741824" returned: 0 in 0.810s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:43 devstack sudo[97058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90
Aug 04 09:24:43 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:43 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90" returned: 0 in 0.442s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:24:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2746d66-679a-4d2e-8274-6c3927260d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c59efd-10b7-4176-9ec9-432799e84348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:43 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Volume volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90 (d594f0f2-a1a4-49b2-b77a-8b3ee3679f90): created successfully
Aug 04 09:24:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c59efd-10b7-4176-9ec9-432799e84348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Flow 'volume_create_manager' (8ec9e75a-9fdb-410b-9712-89b6f8874bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:24:43 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e69d4557-b601-425c-9770-c27c640ac881 tempest-GroupsTest-589152492 None] Created volume successfully.
Aug 04 09:24:45 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6e53fd63-2639-46f2-88cd-82e441e81cb4 tempest-GroupsTest-589152492 None] Update group completed successfully.
Aug 04 09:24:45 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-e155ae5d-f016-4cb5-ac81-5bf4253ee6c2 req-9012b221-271e-4553-9885-e383bf514ac8 tempest-ServerActionsTestOtherA-2089351963 None] Terminate volume connection completed successfully.
Aug 04 09:24:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-e155ae5d-f016-4cb5-ac81-5bf4253ee6c2 req-9012b221-271e-4553-9885-e383bf514ac8 tempest-ServerActionsTestOtherA-2089351963 None] Deleting attachment 552ab4fc-77b0-4692-87d9-0b058c59483a. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:24:46 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6f2ec214-3b0f-457f-81b2-0ab640e51f05 tempest-GroupsTest-589152492 None] Update group completed successfully.
Aug 04 09:24:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Acquiring lock "cinder-quobyte-80c9b741-74fc-4237-b88b-a742e9870aba" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Lock "cinder-quobyte-80c9b741-74fc-4237-b88b-a742e9870aba" acquired by "delete_volume" :: waited 0.033s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:49 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cce585-e037-4c1c-9a6a-34f2e0f67326]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-80c9b741-74fc-4237-b88b-a742e9870aba {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:49 devstack sudo[97121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-80c9b741-74fc-4237-b88b-a742e9870aba
Aug 04 09:24:49 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:49 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-80c9b741-74fc-4237-b88b-a742e9870aba" returned: 0 in 0.562s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-80c9b741-74fc-4237-b88b-a742e9870aba {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:49 devstack sudo[97127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-80c9b741-74fc-4237-b88b-a742e9870aba
Aug 04 09:24:49 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:49 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-80c9b741-74fc-4237-b88b-a742e9870aba" returned: 0 in 0.274s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Lock "cinder-quobyte-80c9b741-74fc-4237-b88b-a742e9870aba" released by "delete_volume" :: held 0.911s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Acquiring lock "cinder-quobyte-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:24:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Lock "cinder-quobyte-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90" acquired by "delete_volume" :: waited 0.033s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:24:50 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d16cb3c-6072-4cfe-926e-6f2f55f993e5]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:50 devstack sudo[97130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90
Aug 04 09:24:50 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:50 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90" returned: 0 in 0.623s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:50 devstack sudo[97136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90
Aug 04 09:24:50 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:51 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90" returned: 0 in 0.322s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Lock "cinder-quobyte-d594f0f2-a1a4-49b2-b77a-8b3ee3679f90" released by "delete_volume" :: held 1.014s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:24:51 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Created reservations ['aa616a92-831c-4407-b1ba-3b13a0c63153'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:51 devstack cinder-volume[88880]: WARNING cinder.quota [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-993206424 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-993206424, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:24:51 devstack cinder-volume[88880]: WARNING cinder.quota [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-993206424 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-993206424, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:24:51 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Created reservations ['446b9c07-7ef8-4470-b359-ceb0ba82d4a8', '4ac79f65-091d-4ae0-b87d-7826b58eff43', '23e4fece-9055-4b76-8096-5ff83625ce15', 'a37f2f13-44a3-477b-a624-c367cb3dfd63'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:51 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Created reservations ['f0045b72-8b8c-44b9-9a81-713c97673fb2', 'e0357a5e-b13b-41c3-b23b-1ef253dc7526', '05695b81-d336-4b5b-8ed4-6d8be264c021', 'ea66a563-407f-47dc-9f2b-40b6ea4c9adf'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:24:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:51 devstack sudo[97189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:24:51 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:52 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.541s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:52 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:24:52 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-bd9bad0a-28b1-4302-98df-2b78b199718a tempest-GroupsTest-589152492 None] Delete group completed successfully.
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Flow 'volume_create_manager' (bcb743aa-f392-4559-82b8-f9d35ed2c48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f5419b-7f2f-4ace-a7c8-432e0527fd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f5419b-7f2f-4ace-a7c8-432e0527fd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e19a384c4b448f4b4900cc4d2c0eada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:24:53Z,use_quota=True,user_id='117d56a9d5e3411c9ff04f655a88c104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfed70fa-cd08-4f0b-be30-335ebe04b996),volume_type_id=cfed70fa-cd08-4f0b-be30-335ebe04b996)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1339a0-cc85-4767-a97e-84c204ad0347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1339a0-cc85-4767-a97e-84c204ad0347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dddf5d3a-f994-4422-b491-b65060654172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.image.glance [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Creating Keystone auth plugin from conf {{(pid=88880) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Flow 'volume_create_manager' (63b62509-70b4-4d4f-873d-fd53d6ecbc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958004b9-f53f-4b7c-9750-3f0b7d09385f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958004b9-f53f-4b7c-9750-3f0b7d09385f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-872278644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203a19a5-acbd-47db-9ec9-3a174fbaafa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e7a5c915314317803c6f1e4d7ff505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:24:53Z,use_quota=True,user_id='564b59b983834ef096cdc9e95051af94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb722dac-71df-4472-8c3f-6c72d392ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb722dac-71df-4472-8c3f-6c72d392ee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea62f5f8-5372-4091-93f2-44dc53a2c025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:53 devstack cinder-volume[88880]: DEBUG cinder.image.glance [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Creating Keystone auth plugin from conf {{(pid=88880) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dddf5d3a-f994-4422-b491-b65060654172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab', 'volume_name': 'volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab', 'volume_size': 1, 'image_id': 'd273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b81c494b89bcf13ce0a627a6804dd907', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e19a384c4b448f4b4900cc4d2c0eada', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23c62190dfb219329489755cfa97ba9595ce4501007be8e0f92d6bb293e903e1e08f6e8ebd791311981f40dd8526197fce817defca880e454def78c7d8ea5bd5', 'id': 'd273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'created_at': datetime.datetime(2026, 8, 4, 7, 24, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 24, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d273fa17-269b-4419-8f3e-2ee3f45b8dd4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dafd92ae0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c290966a-5502-4081-ab09-4b2a3acf92e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c290966a-5502-4081-ab09-4b2a3acf92e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2bfb14-b2a1-4286-b083-b104c009d75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:54 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Volume b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab', 'volume_size': 1, 'image_id': 'd273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b81c494b89bcf13ce0a627a6804dd907', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e19a384c4b448f4b4900cc4d2c0eada', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23c62190dfb219329489755cfa97ba9595ce4501007be8e0f92d6bb293e903e1e08f6e8ebd791311981f40dd8526197fce817defca880e454def78c7d8ea5bd5', 'id': 'd273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'created_at': datetime.datetime(2026, 8, 4, 7, 24, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 24, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d273fa17-269b-4419-8f3e-2ee3f45b8dd4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dafd92ae0>}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Trying to clone b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab from image d273fa17-269b-4419-8f3e-2ee3f45b8dd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'metadata': {}}]). {{(pid=88880) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea62f5f8-5372-4091-93f2-44dc53a2c025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '203a19a5-acbd-47db-9ec9-3a174fbaafa2', 'volume_name': 'volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba0836b0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f10bcf-73cc-4f32-a311-fa6d46a7925c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f10bcf-73cc-4f32-a311-fa6d46a7925c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fd6891-4db6-4bee-9f22-f9b7f22063ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:24:54 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Volume 203a19a5-acbd-47db-9ec9-3a174fbaafa2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba0836b0>}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Trying to clone 203a19a5-acbd-47db-9ec9-3a174fbaafa2 from image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]). {{(pid=88880) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 04 09:24:54 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Image download 0.00 MB at 0.00 MB/s
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e7939e-58ef-4b67-b3d9-06945e362be8]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:54 devstack sudo[97233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD
Aug 04 09:24:54 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 04 09:24:54 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Image download 20.69 MB at 20.69 MB/s
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[378765fb-2b12-48dc-8767-fc4b332a82e8]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:55 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD" returned: 0 in 0.649s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:55 devstack sudo[97236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD
Aug 04 09:24:55 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:55 devstack sudo[97239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD
Aug 04 09:24:55 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:55 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD" returned: 0 in 0.669s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:55 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Temporary image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 is fetched for user 564b59b983834ef096cdc9e95051af94. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 04 09:24:55 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD" returned: 1 in 0.607s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:24:55 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Temporary image d273fa17-269b-4419-8f3e-2ee3f45b8dd4 is fetched for user 117d56a9d5e3411c9ff04f655a88c104. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 04 09:24:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c033e0a-15b0-47ce-a99a-6bacbb5e6026]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3e9b03-ff6b-48fd-9bcc-985b115784ff]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:55 devstack sudo[97249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD
Aug 04 09:24:55 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:55 devstack sudo[97248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD
Aug 04 09:24:55 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:56 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD" returned: 0 in 0.410s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:56 devstack sudo[97254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD
Aug 04 09:24:56 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:56 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD" returned: 0 in 0.651s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-872278644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203a19a5-acbd-47db-9ec9-3a174fbaafa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e7a5c915314317803c6f1e4d7ff505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:24:53Z,use_quota=True,user_id='564b59b983834ef096cdc9e95051af94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Creating volume 203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:24:56 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:56 devstack sudo[97259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 1073741824
Aug 04 09:24:56 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:56 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD" returned: 1 in 0.732s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:24:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:57 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 1073741824" returned: 0 in 0.754s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:57 devstack sudo[97270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2
Aug 04 09:24:57 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:57 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2" returned: 0 in 0.294s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e19a384c4b448f4b4900cc4d2c0eada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:24:53Z,use_quota=True,user_id='117d56a9d5e3411c9ff04f655a88c104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfed70fa-cd08-4f0b-be30-335ebe04b996),volume_type_id=cfed70fa-cd08-4f0b-be30-335ebe04b996)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Creating volume b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:24:57 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:57 devstack sudo[97273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab 1073741824
Aug 04 09:24:57 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Attempting download of 3846a4df-9a56-4b6a-83ff-12d6b09a1144 ((None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}])) to volume 203a19a5-acbd-47db-9ec9-3a174fbaafa2. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[990b8d1f-ac54-485a-9d25-15135c1c3935]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_wmy9un9m {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:57 devstack sudo[97275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_wmy9un9m
Aug 04 09:24:57 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:58 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab 1073741824" returned: 0 in 0.559s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:58 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_wmy9un9m" returned: 0 in 0.469s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_wmy9un9m {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:58 devstack sudo[97283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab
Aug 04 09:24:58 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:58 devstack sudo[97284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_wmy9un9m
Aug 04 09:24:58 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:58 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab" returned: 0 in 0.316s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Attempting download of d273fa17-269b-4419-8f3e-2ee3f45b8dd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'metadata': {}}])) to volume b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[db12da49-0e78-40fa-b89d-f8257a1ec887]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_jw0br0sq {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:58 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_wmy9un9m" returned: 1 in 0.458s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_wmy9un9m' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e110488-988a-4b81-8284-7b261f2d1249]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:58 devstack sudo[97290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_jw0br0sq
Aug 04 09:24:58 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:58 devstack sudo[97291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD
Aug 04 09:24:58 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:59 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_jw0br0sq" returned: 0 in 0.421s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_jw0br0sq {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:59 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:59 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] 3846a4df-9a56-4b6a-83ff-12d6b09a1144 was qcow2, converting to raw {{(pid=88880) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 04 09:24:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:59 devstack sudo[97300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2
Aug 04 09:24:59 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:59 devstack sudo[97299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_jw0br0sq
Aug 04 09:24:59 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:59 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_jw0br0sq" returned: 1 in 0.533s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_jw0br0sq' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:24:59 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8308ba5-10f5-4fb3-8b60-7714e756831a]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:24:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:24:59 devstack sudo[97313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD
Aug 04 09:24:59 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:24:59 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root
Aug 04 09:24:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:24:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:00 devstack sudo[97317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD
Aug 04 09:25:00 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:00 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD" returned: 1 in 0.506s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:25:00 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] d273fa17-269b-4419-8f3e-2ee3f45b8dd4 was raw, converting to raw {{(pid=88880) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 04 09:25:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:00 devstack sudo[97322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab
Aug 04 09:25:00 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:00 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab" returned: 0 in 0.487s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:00 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d273fa17-269b-4419-8f3e-2ee3f45b8dd4_59mt0n25devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:25:00 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Converted 0.00 MB image at 0.00 MB/s
Aug 04 09:25:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:01 devstack sudo[97468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab 1G
Aug 04 09:25:01 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:01 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2" returned: 0 in 1.945s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_14475i7qdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:25:01 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Converted 112.00 MB image at 57.55 MB/s
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:01 devstack sudo[97509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 1G
Aug 04 09:25:01 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:01 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab 1G" returned: 0 in 0.478s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70aa16b-01fc-4ad6-9348-8203c0211ddd]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:01 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 1G" returned: 0 in 0.449s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Flow 'volume_create_manager' (dc714d08-d39a-4cff-bce4-f710717c07b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ef1abe-9cc9-4f41-9b11-28c85b4bd44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3096353a-e1b2-44c9-b7b8-65d9c490567c]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ef1abe-9cc9-4f41-9b11-28c85b4bd44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-302107733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f86c425-eddd-49db-95db-4b06a1caeb7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d464bdae7cf740b58bba3c7fd465a5b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:25:01Z,use_quota=True,user_id='c411b3eabd4342cf9e020ee43d377f5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:01 devstack sudo[97615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab
Aug 04 09:25:01 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfb3a4b-632e-4208-a05a-ca6f64ae037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfb3a4b-632e-4208-a05a-ca6f64ae037d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536ac32b-4e9a-45af-8942-25b230432898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536ac32b-4e9a-45af-8942-25b230432898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f86c425-eddd-49db-95db-4b06a1caeb7a', 'volume_name': 'volume-6f86c425-eddd-49db-95db-4b06a1caeb7a', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2571b9e-26f5-426d-bb96-0846c0746d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2571b9e-26f5-426d-bb96-0846c0746d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d468d1-1bcf-4ebb-ab9f-e176ac51528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:01 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Volume 6f86c425-eddd-49db-95db-4b06a1caeb7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f86c425-eddd-49db-95db-4b06a1caeb7a', 'volume_size': 1}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-302107733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f86c425-eddd-49db-95db-4b06a1caeb7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d464bdae7cf740b58bba3c7fd465a5b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:25:01Z,use_quota=True,user_id='c411b3eabd4342cf9e020ee43d377f5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Creating volume 6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:25:01 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:25:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:01 devstack sudo[97669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a 1073741824
Aug 04 09:25:01 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:01 devstack sudo[97657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2
Aug 04 09:25:01 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:02 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab" returned: 0 in 0.502s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:02 devstack sudo[97679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab
Aug 04 09:25:02 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:02 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2" returned: 0 in 0.550s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:02 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a 1073741824" returned: 0 in 0.525s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:02 devstack sudo[97684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2
Aug 04 09:25:02 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:02 devstack sudo[97687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a
Aug 04 09:25:02 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:02 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab" returned: 1 in 0.482s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Downloaded image d273fa17-269b-4419-8f3e-2ee3f45b8dd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'metadata': {}}])) to volume b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab successfully. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Temporary image d273fa17-269b-4419-8f3e-2ee3f45b8dd4 for user 117d56a9d5e3411c9ff04f655a88c104 is deleted. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Marking volume b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab as bootable. {{(pid=88880) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Copying metadata from image d273fa17-269b-4419-8f3e-2ee3f45b8dd4 to b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab. {{(pid=88880) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Creating volume glance metadata for volume b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab backed by image d273fa17-269b-4419-8f3e-2ee3f45b8dd4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b81c494b89bcf13ce0a627a6804dd907', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88880) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2bfb14-b2a1-4286-b083-b104c009d75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab', 'volume_size': 1, 'image_id': 'd273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b81c494b89bcf13ce0a627a6804dd907', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e19a384c4b448f4b4900cc4d2c0eada', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23c62190dfb219329489755cfa97ba9595ce4501007be8e0f92d6bb293e903e1e08f6e8ebd791311981f40dd8526197fce817defca880e454def78c7d8ea5bd5', 'id': 'd273fa17-269b-4419-8f3e-2ee3f45b8dd4', 'created_at': datetime.datetime(2026, 8, 4, 7, 24, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 24, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d273fa17-269b-4419-8f3e-2ee3f45b8dd4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dafd92ae0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347318d1-04f9-4570-a463-bcf898577f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:02 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a" returned: 0 in 0.321s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:02 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Volume volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab (b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab): created successfully
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347318d1-04f9-4570-a463-bcf898577f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Flow 'volume_create_manager' (bcb743aa-f392-4559-82b8-f9d35ed2c48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d468d1-1bcf-4ebb-ab9f-e176ac51528d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f86c425-eddd-49db-95db-4b06a1caeb7a', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bbc048-6be7-4910-a955-c5277fa4eb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:02 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ec82066c-e7e1-4040-83bc-f4a1496061dc tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Created volume successfully.
Aug 04 09:25:02 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:02 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Volume volume-6f86c425-eddd-49db-95db-4b06a1caeb7a (6f86c425-eddd-49db-95db-4b06a1caeb7a): created successfully
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bbc048-6be7-4910-a955-c5277fa4eb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Flow 'volume_create_manager' (dc714d08-d39a-4cff-bce4-f710717c07b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2" returned: 1 in 0.573s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Downloaded image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 ((None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}])) to volume 203a19a5-acbd-47db-9ec9-3a174fbaafa2 successfully. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Temporary image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 for user 564b59b983834ef096cdc9e95051af94 is deleted. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Marking volume 203a19a5-acbd-47db-9ec9-3a174fbaafa2 as bootable. {{(pid=88880) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 04 09:25:02 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6733225d-7786-491a-b1a1-3a42bc14f7c5 tempest-SnapshotsActionsTest-1442451970 None] Created volume successfully.
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Copying metadata from image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 to 203a19a5-acbd-47db-9ec9-3a174fbaafa2. {{(pid=88880) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Creating volume glance metadata for volume 203a19a5-acbd-47db-9ec9-3a174fbaafa2 backed by image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88880) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fd6891-4db6-4bee-9f22-f9b7f22063ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba0836b0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8267cb-bb2a-4c59-9d0b-412651d56589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Acquiring lock "cinder-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:02 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Volume volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 (203a19a5-acbd-47db-9ec9-3a174fbaafa2): created successfully
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8267cb-bb2a-4c59-9d0b-412651d56589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Flow 'volume_create_manager' (63b62509-70b4-4d4f-873d-fd53d6ecbc41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:25:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Lock "cinder-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:03 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d3e7cf78-93d3-4229-b004-d009c3244903 tempest-ServerActionsTestOtherA-2089351963 None] Created volume successfully.
Aug 04 09:25:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Acquiring lock "cinder-quobyte-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Lock "cinder-quobyte-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab" acquired by "delete_volume" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:03 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9155b53c-0c93-4195-b835-e79f6a995127]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:03 devstack sudo[97696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab
Aug 04 09:25:03 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:03 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab" returned: 0 in 0.433s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:03 devstack sudo[97701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab
Aug 04 09:25:03 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] Creating offline snapshot 83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 of volume 6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c95841a-041c-4864-8428-19d4b420a0dd]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:04 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab" returned: 1 in 0.554s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:04 devstack sudo[97707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab
Aug 04 09:25:04 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:04 devstack sudo[97706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a
Aug 04 09:25:04 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:04 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab" returned: 0 in 0.303s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Lock "cinder-quobyte-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab" released by "delete_volume" :: held 1.372s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:04 devstack cinder-volume[88880]: WARNING cinder.quota [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:25:04 devstack cinder-volume[88880]: WARNING cinder.quota [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Created reservations ['057fc93e-b353-4846-ade2-e9bc3bb0345e', '69400f1f-ad73-4cd5-88e1-691768fc13c8', '6e91fac5-6ec9-4703-9357-8c394d8d3ae1', 'd8712fbc-a952-4df0-9d01-93a8d129d61f'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:25:04 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a" returned: 0 in 0.521s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:04 devstack sudo[97715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 1G
Aug 04 09:25:04 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:04 devstack sudo[97719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:25:04 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:05 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.444s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:05 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:25:05 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Deleted volume successfully.
Aug 04 09:25:05 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7de66ed0-600c-4293-a097-30c223536b27 tempest-VolumeAndVolumeTypeFromImageTest-1994545499 None] Lock "cinder-b5980b7e-6d78-4ca7-98c5-cdbb5ecc67ab-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 1G" returned: 0 in 0.588s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:05 devstack sudo[97726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:05 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:05 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.368s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:05 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 is being set with open permissions: ugo+rw
Aug 04 09:25:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:05 devstack sudo[97732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:05 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:05 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.359s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:06 devstack sudo[97735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.info
Aug 04 09:25:06 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:06 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.info" returned: 0 in 0.343s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:06 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.info is being set with open permissions: ugo+rw
Aug 04 09:25:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:06 devstack sudo[97738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.info
Aug 04 09:25:06 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:06 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.info" returned: 0 in 0.356s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.727s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:06 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e610bb7f-dbbe-42e7-9843-5e3083ad3295 tempest-SnapshotsActionsTest-1442451970 None] Create snapshot completed successfully
Aug 04 09:25:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-e00d2179-697b-480b-ab8c-c520bfedbd17 req-31375889-af80-4874-ae46-5f28af6d4d7e tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-e00d2179-697b-480b-ab8c-c520bfedbd17 req-31375889-af80-4874-ae46-5f28af6d4d7e tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:07 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2193a81a-c4dc-4509-ba35-ff85b31150a1]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e00d2179-697b-480b-ab8c-c520bfedbd17 req-31375889-af80-4874-ae46-5f28af6d4d7e tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:07 devstack sudo[97786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2
Aug 04 09:25:07 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:07 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e00d2179-697b-480b-ab8c-c520bfedbd17 req-31375889-af80-4874-ae46-5f28af6d4d7e tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2" returned: 0 in 0.464s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e00d2179-697b-480b-ab8c-c520bfedbd17 req-31375889-af80-4874-ae46-5f28af6d4d7e tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:07 devstack sudo[97790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2
Aug 04 09:25:07 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:08 devstack sudo[97793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:25:08 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:08 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e00d2179-697b-480b-ab8c-c520bfedbd17 req-31375889-af80-4874-ae46-5f28af6d4d7e tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2" returned: 1 in 0.550s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-e00d2179-697b-480b-ab8c-c520bfedbd17 req-31375889-af80-4874-ae46-5f28af6d4d7e tempest-ServerActionsTestOtherA-2089351963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-e00d2179-697b-480b-ab8c-c520bfedbd17 req-31375889-af80-4874-ae46-5f28af6d4d7e tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.126s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.100s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] Creating offline snapshot 8a3248d1-55e9-47b4-a477-2ff0c370ced0 of volume 6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf6eb1-539d-4977-a661-7e000b9bfd36]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:08 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.357s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-e00d2179-697b-480b-ab8c-c520bfedbd17 req-31375889-af80-4874-ae46-5f28af6d4d7e tempest-ServerActionsTestOtherA-2089351963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f47c838f-25ed-4cbc-9439-9b977b51552b', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:25:08 devstack sudo[97799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:08 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:08 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-e00d2179-697b-480b-ab8c-c520bfedbd17 req-31375889-af80-4874-ae46-5f28af6d4d7e tempest-ServerActionsTestOtherA-2089351963 None] attachment_update completed successfully.
Aug 04 09:25:08 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.506s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:08 devstack sudo[97805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0 1G
Aug 04 09:25:08 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:09 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0 1G" returned: 0 in 0.489s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:09 devstack sudo[97812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0
Aug 04 09:25:09 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:09 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0" returned: 0 in 0.328s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:09 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0 is being set with open permissions: ugo+rw
Aug 04 09:25:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:09 devstack sudo[97818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0
Aug 04 09:25:09 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:10 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0" returned: 0 in 0.328s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:10 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ae2589ae-c1f2-41ba-9786-a7413393195a tempest-SnapshotsActionsTest-1442451970 None] Create snapshot completed successfully
Aug 04 09:25:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Acquiring lock "cinder-8a3248d1-55e9-47b4-a477-2ff0c370ced0-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-8a3248d1-55e9-47b4-a477-2ff0c370ced0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Acquiring lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Acquiring lock "cinder-quobyte-8a3248d1-55e9-47b4-a477-2ff0c370ced0" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-8a3248d1-55e9-47b4-a477-2ff0c370ced0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Deleting offline snapshot 8a3248d1-55e9-47b4-a477-2ff0c370ced0 of volume 6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:25:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] snapshot_file for this snap is: volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:25:10 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[250244f9-aa5a-4fa6-b39f-a8117e1e8f78]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:10 devstack sudo[97822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0
Aug 04 09:25:10 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:11 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0" returned: 0 in 0.499s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:11 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18a8ba2-2277-461a-b9c3-5eeff1efb401]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:11 devstack sudo[97981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:11 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:11 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.716s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:11 devstack sudo[98326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0
Aug 04 09:25:11 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:12 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0" returned: 0 in 0.540s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:12 devstack sudo[98342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0
Aug 04 09:25:12 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Flow 'volume_create_manager' (ee100a80-f934-4236-8329-6e9e4ab164c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fda9645-91cd-4da9-ac29-67718a4e51d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fda9645-91cd-4da9-ac29-67718a4e51d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1011915644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b68d9bf-d17b-42f8-85e5-7ae31ed01d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5924b51466a240a789eb6df317119dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:25:12Z,use_quota=True,user_id='a390aadb8cec44719c21c321101d6650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6c0d3e-410c-4f26-b295-67c1cfe74bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6c0d3e-410c-4f26-b295-67c1cfe74bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96dc45f1-5ee5-490a-9ef6-7840cebb174a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96dc45f1-5ee5-490a-9ef6-7840cebb174a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b68d9bf-d17b-42f8-85e5-7ae31ed01d05', 'volume_name': 'volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59491f3-9ac5-45a8-b33b-0be11cb2cd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59491f3-9ac5-45a8-b33b-0be11cb2cd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5412ffd-bce5-45d6-ba0b-0961f2d224de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:12 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Volume 0b68d9bf-d17b-42f8-85e5-7ae31ed01d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05', 'volume_size': 1}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1011915644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b68d9bf-d17b-42f8-85e5-7ae31ed01d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5924b51466a240a789eb6df317119dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:25:12Z,use_quota=True,user_id='a390aadb8cec44719c21c321101d6650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Creating volume 0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:25:12 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:12 devstack sudo[98348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 1073741824
Aug 04 09:25:12 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:12 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.8a3248d1-55e9-47b4-a477-2ff0c370ced0" returned: 0 in 0.290s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-8a3248d1-55e9-47b4-a477-2ff0c370ced0" released by "_delete_snapshot" :: held 2.172s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" released by "delete_snapshot" :: held 2.198s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Created reservations ['d55af824-a4f7-46f1-981a-ef680d0b25fb', 'a8fb1fb2-fdeb-45ca-8c0e-3ab80b6f8ad2', '8692ceed-20d1-428a-bf38-3bb7ffbcd2b2', '627ed269-adb2-4330-8805-ff2544056716'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:25:12 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Delete snapshot completed successfully.
Aug 04 09:25:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1dc0e322-cc22-4a26-a4dd-e694e73cebd6 tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-8a3248d1-55e9-47b4-a477-2ff0c370ced0-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:13 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 1073741824" returned: 0 in 0.593s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:13 devstack sudo[98369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05
Aug 04 09:25:13 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:13 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" returned: 0 in 0.280s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:25:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5412ffd-bce5-45d6-ba0b-0961f2d224de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0b3039-c9da-4bb2-8dec-e41164c49023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:13 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Volume volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 (0b68d9bf-d17b-42f8-85e5-7ae31ed01d05): created successfully
Aug 04 09:25:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0b3039-c9da-4bb2-8dec-e41164c49023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Flow 'volume_create_manager' (ee100a80-f934-4236-8329-6e9e4ab164c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:25:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9eda527e-7353-4c35-8f39-bf897980a657 tempest-VolumeDependencyTests-893541767 None] Created volume successfully.
Aug 04 09:25:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] Creating offline snapshot 747c2c2e-bf27-4ca1-9b38-fbe6365bb76c of volume 6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:25:14 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43e4b76-552a-4a72-89e6-c445c90aecf2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:14 devstack sudo[98374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:14 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:14 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.454s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:14 devstack sudo[98379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c 1G
Aug 04 09:25:14 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:15 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c 1G" returned: 0 in 0.600s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:15 devstack sudo[98384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c
Aug 04 09:25:15 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:15 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c" returned: 0 in 0.380s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:15 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c is being set with open permissions: ugo+rw
Aug 04 09:25:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:15 devstack sudo[98390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c
Aug 04 09:25:15 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:16 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c" returned: 0 in 0.306s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.423s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] Creating offline snapshot 6bd2889f-a50c-4004-aa06-176fdc7f3bcf of volume 0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:25:16 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a939f61a-0428-4d55-b57c-cff37c882eda tempest-SnapshotsActionsTest-1442451970 None] Create snapshot completed successfully
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d7235-4151-4130-9950-196550af2838]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:16 devstack sudo[98393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05
Aug 04 09:25:16 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Acquiring lock "cinder-747c2c2e-bf27-4ca1-9b38-fbe6365bb76c-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-747c2c2e-bf27-4ca1-9b38-fbe6365bb76c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Acquiring lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Acquiring lock "cinder-quobyte-747c2c2e-bf27-4ca1-9b38-fbe6365bb76c" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-747c2c2e-bf27-4ca1-9b38-fbe6365bb76c" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Deleting offline snapshot 747c2c2e-bf27-4ca1-9b38-fbe6365bb76c of volume 6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] snapshot_file for this snap is: volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1c454d-6982-447a-ba1c-2187409a75a9]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:17 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" returned: 0 in 0.743s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:17 devstack sudo[98404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf 1G
Aug 04 09:25:17 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:17 devstack sudo[98402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c
Aug 04 09:25:17 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:17 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c" returned: 0 in 0.737s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[609308cd-16ac-488c-aa53-d2e553fae4d6]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=94,cinder:UPDATE=92,cinder:DELETE=11,cinder:INSERT=25 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=104,cinder:UPDATE=87,cinder:INSERT=33,cinder:DELETE=1 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Flow 'volume_create_manager' (1ad9fb17-5379-40bc-801b-0b13e21e24fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:25:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7143ea5-5ac7-4159-827b-bf1db17836e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7143ea5-5ac7-4159-827b-bf1db17836e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1949374696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f571bcb56d34bd0b339eaf94802a9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:25:18Z,use_quota=True,user_id='2b2f063fcaef4e4aaaf3d0ab7bbf1d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0d43d8-f35b-4ecc-a2a7-15902c729833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0d43d8-f35b-4ecc-a2a7-15902c729833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:18 devstack sudo[98415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:18 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8a698d-02a8-4f30-9bf6-ebb40b1c6a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8a698d-02a8-4f30-9bf6-ebb40b1c6a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e', 'volume_name': 'volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0472bf7-9d44-4ce0-9253-5e6b38a10ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:18 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0472bf7-9d44-4ce0-9253-5e6b38a10ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7aa6557-496f-46b4-abcc-9e58e47379aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:18 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Volume 7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e', 'volume_size': 1}
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf 1G" returned: 0 in 1.074s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:18 devstack sudo[98417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf
Aug 04 09:25:18 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:18 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf" returned: 0 in 0.447s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:18 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf is being set with open permissions: ugo+rw
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:18 devstack sudo[98425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf
Aug 04 09:25:18 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:18 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.851s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:18 devstack sudo[98427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c
Aug 04 09:25:18 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:19 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf" returned: 0 in 0.435s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:19 devstack sudo[98435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.info
Aug 04 09:25:19 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:19 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c" returned: 0 in 0.589s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:19 devstack sudo[98438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c
Aug 04 09:25:19 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:19 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.info" returned: 0 in 0.437s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:19 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.info is being set with open permissions: ugo+rw
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:19 devstack sudo[98441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.info
Aug 04 09:25:19 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:19 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.747c2c2e-bf27-4ca1-9b38-fbe6365bb76c" returned: 0 in 0.379s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-747c2c2e-bf27-4ca1-9b38-fbe6365bb76c" released by "_delete_snapshot" :: held 2.753s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" released by "delete_snapshot" :: held 2.822s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Created reservations ['fe1cf3f7-3e99-408b-898e-88bd56e0c6ca', 'a7b8cddb-8b32-45dd-9ac5-dec34b3e1483', 'b97017dd-b4ed-4149-9c2f-3f268760e81e', 'ca9d6d52-a8e0-47f7-a034-20a74acf0b05'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:25:19 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.info" returned: 0 in 0.306s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.607s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.731s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1949374696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f571bcb56d34bd0b339eaf94802a9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:25:18Z,use_quota=True,user_id='2b2f063fcaef4e4aaaf3d0ab7bbf1d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Creating volume 7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:25:19 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:19 devstack sudo[98445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e 1073741824
Aug 04 09:25:19 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:19 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-381e267b-36f4-4648-9dc3-9c14b886a36a tempest-VolumeDependencyTests-893541767 None] Create snapshot completed successfully
Aug 04 09:25:19 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Delete snapshot completed successfully.
Aug 04 09:25:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9f6ff5c-493b-4a73-9729-2ef54e60047b tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-747c2c2e-bf27-4ca1-9b38-fbe6365bb76c-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:20 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e 1073741824" returned: 0 in 0.846s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:20 devstack sudo[98452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e
Aug 04 09:25:20 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:21 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e" returned: 0 in 0.417s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.549s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7aa6557-496f-46b4-abcc-9e58e47379aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d7b20d-8d74-4b88-a90f-3be35c8b243d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] Creating offline snapshot bd0a8614-75cd-4b37-9144-c8d8f6c989b4 of volume 6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:25:21 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Volume volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e (7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e): created successfully
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d7b20d-8d74-4b88-a90f-3be35c8b243d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Flow 'volume_create_manager' (1ad9fb17-5379-40bc-801b-0b13e21e24fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba2ea97-8a16-4d7f-97f6-79aa27a9e1ae]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:21 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6bb130c5-2001-49d8-a472-b09d74c18e43 tempest-AttachVolumeNegativeTest-873513332 None] Created volume successfully.
Aug 04 09:25:21 devstack sudo[98455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:21 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Flow 'volume_create_manager' (2d06c846-4aa6-4eef-8ba2-510a93b48291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad76e12f-0e1f-4024-9230-da8e0d652812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad76e12f-0e1f-4024-9230-da8e0d652812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1114800926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e837271e-9349-4c95-a857-41466b9307c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5924b51466a240a789eb6df317119dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6bd2889f-a50c-4004-aa06-176fdc7f3bcf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:25:21Z,use_quota=True,user_id='a390aadb8cec44719c21c321101d6650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ed2937-a7f0-40e7-bb8e-53831891f100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ed2937-a7f0-40e7-bb8e-53831891f100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c32595f-dae9-4d09-9a9f-7f2e14bea87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c32595f-dae9-4d09-9a9f-7f2e14bea87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e837271e-9349-4c95-a857-41466b9307c5', 'volume_name': 'volume-e837271e-9349-4c95-a857-41466b9307c5', 'volume_size': 1, 'snapshot_id': '6bd2889f-a50c-4004-aa06-176fdc7f3bcf'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11cda7df-2ceb-4654-b7cd-858b1ef00e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11cda7df-2ceb-4654-b7cd-858b1ef00e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cd5878-17aa-402e-9e42-4339bdbb7ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:21 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Volume e837271e-9349-4c95-a857-41466b9307c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e837271e-9349-4c95-a857-41466b9307c5', 'volume_size': 1, 'snapshot_id': '6bd2889f-a50c-4004-aa06-176fdc7f3bcf'}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:21 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.500s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:21 devstack sudo[98461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4 1G
Aug 04 09:25:21 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:22 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4 1G" returned: 0 in 0.726s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:22 devstack sudo[98471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4
Aug 04 09:25:22 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:23 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4" returned: 0 in 0.502s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:23 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4 is being set with open permissions: ugo+rw
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:23 devstack sudo[98486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4
Aug 04 09:25:23 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-250e4313-cfae-42a7-ab0e-e1115c1170a0 req-38d2fb56-9722-4887-a563-e61f5a20534e tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:23 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4" returned: 0 in 0.284s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.211s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.752s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Acquiring lock "cinder-quobyte-6bd2889f-a50c-4004-aa06-176fdc7f3bcf-e837271e-9349-4c95-a857-41466b9307c5" by "_create_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Lock "cinder-quobyte-6bd2889f-a50c-4004-aa06-176fdc7f3bcf-e837271e-9349-4c95-a857-41466b9307c5" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Creating volume e837271e-9349-4c95-a857-41466b9307c5 from snapshot 6bd2889f-a50c-4004-aa06-176fdc7f3bcf {{(pid=88880) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Acquiring lock "cinder-quobyte-e837271e-9349-4c95-a857-41466b9307c5" by "_copy_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:23 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-5c10a763-5836-41e7-96b6-9f2db9c4cab4 tempest-SnapshotsActionsTest-1442451970 None] Create snapshot completed successfully
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Lock "cinder-quobyte-e837271e-9349-4c95-a857-41466b9307c5" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] snapshot: 6bd2889f-a50c-4004-aa06-176fdc7f3bcf, volume: e837271e-9349-4c95-a857-41466b9307c5,  {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bdc568-b75c-441f-bb4c-5532eb275a87]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:23 devstack sudo[98490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf
Aug 04 09:25:23 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Acquiring lock "cinder-bd0a8614-75cd-4b37-9144-c8d8f6c989b4-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:24 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-bd0a8614-75cd-4b37-9144-c8d8f6c989b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Acquiring lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf" returned: 0 in 0.526s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Creating direct copy from snapshot {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Acquiring lock "cinder-quobyte-bd0a8614-75cd-4b37-9144-c8d8f6c989b4" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ac5316-f02c-4781-a6a9-8e65c0b8649b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-bd0a8614-75cd-4b37-9144-c8d8f6c989b4" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Deleting offline snapshot bd0a8614-75cd-4b37-9144-c8d8f6c989b4 of volume 6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] snapshot_file for this snap is: volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fd8b09-8a58-4aef-be36-bd9674aaa656]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:24 devstack sudo[98538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05
Aug 04 09:25:24 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:24 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-bb04e099-6b6d-4c5e-ab79-cb3ad7fa6322 req-7ae2b130-b5fd-4533-8727-ae3d54e02ee1 tempest-ServerActionsTestOtherA-2089351963 None] Terminate volume connection completed successfully.
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-bb04e099-6b6d-4c5e-ab79-cb3ad7fa6322 req-7ae2b130-b5fd-4533-8727-ae3d54e02ee1 tempest-ServerActionsTestOtherA-2089351963 None] Deleting attachment f47c838f-25ed-4cbc-9439-9b977b51552b. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:25:24 devstack sudo[98541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4
Aug 04 09:25:24 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:24 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" returned: 0 in 0.556s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.utils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Path /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5 not found in is_blk_device check {{(pid=88880) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:24 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4" returned: 0 in 0.474s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:24 devstack sudo[98554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5
Aug 04 09:25:24 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5381bb2-0790-47ee-8ff7-fbf0cab1a775]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:24 devstack sudo[98556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:24 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:25 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.433s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:25 devstack sudo[98568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4
Aug 04 09:25:25 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:26 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4" returned: 0 in 1.049s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:26 devstack sudo[98580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4
Aug 04 09:25:26 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:26 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.bd0a8614-75cd-4b37-9144-c8d8f6c989b4" returned: 0 in 0.760s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-bd0a8614-75cd-4b37-9144-c8d8f6c989b4" released by "_delete_snapshot" :: held 2.908s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" released by "delete_snapshot" :: held 2.974s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-bb04e099-6b6d-4c5e-ab79-cb3ad7fa6322 req-b0302bf4-97f2-4550-9609-bd5ad3a1d10c tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:27 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Created reservations ['179aa810-39e8-4a12-8c10-a642640f403b', '7e9da9df-482c-450e-a6dc-5c56fa315aad', 'b05bd61c-8e82-418c-a126-4dcaa52442c1', 'ae1f9d47-ce90-403e-aa2a-d97e47d7d9c2'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:25:27 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Delete snapshot completed successfully.
Aug 04 09:25:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3abe21fc-d0a7-40cf-a0a2-0fd1fa0e47ee tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-bd0a8614-75cd-4b37-9144-c8d8f6c989b4-delete_snapshot" released by "delete_snapshot" :: held 3.354s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:29 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5" returned: 0 in 4.965s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:29 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef793d86-d7a2-4d96-8d2a-9f92390b0d8f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:29 devstack sudo[98595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05
Aug 04 09:25:29 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:30 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" returned: 0 in 0.510s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:25:30 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Converted 1024.00 MB image at 206.19 MB/s
Aug 04 09:25:30 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5 is being set with open permissions: ugo+rw
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:30 devstack sudo[98600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5
Aug 04 09:25:30 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:30 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5" returned: 0 in 0.234s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Lock "cinder-quobyte-e837271e-9349-4c95-a857-41466b9307c5" released by "_copy_volume_from_snapshot" :: held 6.904s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Lock "cinder-quobyte-6bd2889f-a50c-4004-aa06-176fdc7f3bcf-e837271e-9349-4c95-a857-41466b9307c5" released by "_create_volume_from_snapshot" :: held 6.944s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.977s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-250e4313-cfae-42a7-ab0e-e1115c1170a0 req-38d2fb56-9722-4887-a563-e61f5a20534e tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.188s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f2b45a-76ac-469e-9b14-e22d3a043b95]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-250e4313-cfae-42a7-ab0e-e1115c1170a0 req-38d2fb56-9722-4887-a563-e61f5a20534e tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cd5878-17aa-402e-9e42-4339bdbb7ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e837271e-9349-4c95-a857-41466b9307c5', 'volume_size': 1, 'snapshot_id': '6bd2889f-a50c-4004-aa06-176fdc7f3bcf'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749b74e2-6c85-41c5-aa3c-ae3f61094079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:25:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Volume volume-e837271e-9349-4c95-a857-41466b9307c5 (e837271e-9349-4c95-a857-41466b9307c5): created successfully
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749b74e2-6c85-41c5-aa3c-ae3f61094079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Flow 'volume_create_manager' (2d06c846-4aa6-4eef-8ba2-510a93b48291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:25:30 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-125c4779-c70e-494a-a55f-3a9a6fadc106 tempest-VolumeDependencyTests-893541767 None] Created volume successfully.
Aug 04 09:25:30 devstack sudo[98603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e
Aug 04 09:25:30 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:30 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-250e4313-cfae-42a7-ab0e-e1115c1170a0 req-38d2fb56-9722-4887-a563-e61f5a20534e tempest-AttachVolumeNegativeTest-873513332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e" returned: 0 in 0.349s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-250e4313-cfae-42a7-ab0e-e1115c1170a0 req-38d2fb56-9722-4887-a563-e61f5a20534e tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.370s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-bb04e099-6b6d-4c5e-ab79-cb3ad7fa6322 req-b0302bf4-97f2-4550-9609-bd5ad3a1d10c tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.534s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-250e4313-cfae-42a7-ab0e-e1115c1170a0 req-38d2fb56-9722-4887-a563-e61f5a20534e tempest-AttachVolumeNegativeTest-873513332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '970437b9-8ed4-40cd-afe8-7236412bfec5', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cb2e29-2fbe-438b-8ecd-430d18ed2f52]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-bb04e099-6b6d-4c5e-ab79-cb3ad7fa6322 req-b0302bf4-97f2-4550-9609-bd5ad3a1d10c tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:30 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-250e4313-cfae-42a7-ab0e-e1115c1170a0 req-38d2fb56-9722-4887-a563-e61f5a20534e tempest-AttachVolumeNegativeTest-873513332 None] attachment_update completed successfully.
Aug 04 09:25:30 devstack sudo[98608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2
Aug 04 09:25:30 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Acquiring lock "cinder-6bd2889f-a50c-4004-aa06-176fdc7f3bcf-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Lock "cinder-6bd2889f-a50c-4004-aa06-176fdc7f3bcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Acquiring lock "cinder-quobyte-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Lock "cinder-quobyte-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Acquiring lock "cinder-quobyte-6bd2889f-a50c-4004-aa06-176fdc7f3bcf" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:31 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Lock "cinder-quobyte-6bd2889f-a50c-4004-aa06-176fdc7f3bcf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Deleting offline snapshot 6bd2889f-a50c-4004-aa06-176fdc7f3bcf of volume 0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] snapshot_file for this snap is: volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-bb04e099-6b6d-4c5e-ab79-cb3ad7fa6322 req-b0302bf4-97f2-4550-9609-bd5ad3a1d10c tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2" returned: 0 in 0.480s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-bb04e099-6b6d-4c5e-ab79-cb3ad7fa6322 req-b0302bf4-97f2-4550-9609-bd5ad3a1d10c tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d59567-21e4-43cc-ad61-eb14157bd5c7]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:31 devstack sudo[98993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2
Aug 04 09:25:31 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:31 devstack sudo[98995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf
Aug 04 09:25:31 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:31 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-bb04e099-6b6d-4c5e-ab79-cb3ad7fa6322 req-b0302bf4-97f2-4550-9609-bd5ad3a1d10c tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2" returned: 1 in 0.446s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-bb04e099-6b6d-4c5e-ab79-cb3ad7fa6322 req-b0302bf4-97f2-4550-9609-bd5ad3a1d10c tempest-ServerActionsTestOtherA-2089351963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-bb04e099-6b6d-4c5e-ab79-cb3ad7fa6322 req-b0302bf4-97f2-4550-9609-bd5ad3a1d10c tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.970s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.144s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] Creating offline snapshot 83eaa6f1-dfc1-4679-9f3f-569ee6b6551a of volume 6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:25:31 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf" returned: 0 in 0.495s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b8375d-98b0-474c-a415-085b2da553f3]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a89e68-5ee9-4833-b07d-bb77bdf915c1]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-bb04e099-6b6d-4c5e-ab79-cb3ad7fa6322 req-b0302bf4-97f2-4550-9609-bd5ad3a1d10c tempest-ServerActionsTestOtherA-2089351963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cef7949-ac1d-4d08-bad5-6c33e9b8ee38', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:25:31 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-bb04e099-6b6d-4c5e-ab79-cb3ad7fa6322 req-b0302bf4-97f2-4550-9609-bd5ad3a1d10c tempest-ServerActionsTestOtherA-2089351963 None] attachment_update completed successfully.
Aug 04 09:25:31 devstack sudo[99008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:31 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:32 devstack sudo[99009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05
Aug 04 09:25:32 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.467s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:32 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:32 devstack sudo[99019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a 1G
Aug 04 09:25:32 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:32 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" returned: 0 in 0.609s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:32 devstack sudo[99033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf
Aug 04 09:25:32 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:33 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf" returned: 0 in 0.584s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:33 devstack sudo[99055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf
Aug 04 09:25:33 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:33 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a 1G" returned: 0 in 0.835s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:33 devstack sudo[99057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a
Aug 04 09:25:33 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:33 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05.6bd2889f-a50c-4004-aa06-176fdc7f3bcf" returned: 0 in 0.401s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Lock "cinder-quobyte-6bd2889f-a50c-4004-aa06-176fdc7f3bcf" released by "_delete_snapshot" :: held 2.248s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Lock "cinder-quobyte-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" released by "delete_snapshot" :: held 2.285s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:33 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a" returned: 0 in 0.464s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:33 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a is being set with open permissions: ugo+rw
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Created reservations ['904175f4-788a-41dc-a265-5d0a7453cb6d', '80fb091c-7c59-4aa9-9930-dc10aaded172', 'b65904d2-d9da-47ce-b22e-9d0138f437da', '4ba99476-4646-4380-ae2f-442f74db57df'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:25:33 devstack sudo[99070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a
Aug 04 09:25:33 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:33 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Delete snapshot completed successfully.
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3604be8f-3e1a-4f29-bf7e-eeceda6174cd tempest-VolumeDependencyTests-893541767 None] Lock "cinder-6bd2889f-a50c-4004-aa06-176fdc7f3bcf-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:33 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a" returned: 0 in 0.343s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:34 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6d94f60b-629c-4b89-9e14-7abbb64c468d tempest-SnapshotsActionsTest-1442451970 None] Create snapshot completed successfully
Aug 04 09:25:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Acquiring lock "cinder-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Lock "cinder-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Acquiring lock "cinder-quobyte-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Lock "cinder-quobyte-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" acquired by "delete_volume" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:34 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e38ce5-8cae-4741-ac8b-7ab77b51ee56]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:35 devstack sudo[99142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05
Aug 04 09:25:35 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Acquiring lock "cinder-83eaa6f1-dfc1-4679-9f3f-569ee6b6551a-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-83eaa6f1-dfc1-4679-9f3f-569ee6b6551a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Acquiring lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Acquiring lock "cinder-quobyte-83eaa6f1-dfc1-4679-9f3f-569ee6b6551a" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-83eaa6f1-dfc1-4679-9f3f-569ee6b6551a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Deleting offline snapshot 83eaa6f1-dfc1-4679-9f3f-569ee6b6551a of volume 6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] snapshot_file for this snap is: volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc7744e-262d-44e9-8326-cc35d5ca5805]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:35 devstack sudo[99149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a
Aug 04 09:25:35 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:35 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" returned: 0 in 0.748s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:35 devstack sudo[99154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05
Aug 04 09:25:35 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:35 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a" returned: 0 in 0.735s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf10c53d-142b-4132-a0a4-9300fd1c2523]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:36 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" returned: 0 in 0.555s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Lock "cinder-quobyte-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05" released by "delete_volume" :: held 1.439s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:36 devstack sudo[99164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:36 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Created reservations ['b5a8da0a-5638-402a-9019-577e2f7fdd4a', 'fde02295-de8f-4218-8d5b-fca27e2d41d3', '6012946b-b35a-4150-a99b-b41da0e1220b', 'a19ec73b-dbb0-4849-bd8e-b1b3772024dc'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:36 devstack sudo[99166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:25:36 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:36 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.574s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:36 devstack sudo[99175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a
Aug 04 09:25:36 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:36 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.364s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:25:36 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Deleted volume successfully.
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-39b515e3-1b78-4a95-8f09-357f01b7651e tempest-VolumeDependencyTests-893541767 None] Lock "cinder-0b68d9bf-d17b-42f8-85e5-7ae31ed01d05-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Acquiring lock "cinder-e837271e-9349-4c95-a857-41466b9307c5-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Lock "cinder-e837271e-9349-4c95-a857-41466b9307c5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Acquiring lock "cinder-quobyte-e837271e-9349-4c95-a857-41466b9307c5" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Lock "cinder-quobyte-e837271e-9349-4c95-a857-41466b9307c5" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0383be07-58c3-45bd-867a-abb78ddad9d9]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:37 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5
Aug 04 09:25:37 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:37 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a" returned: 0 in 0.648s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:37 devstack sudo[99186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a
Aug 04 09:25:37 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:37 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5" returned: 0 in 0.495s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:37 devstack sudo[99191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5
Aug 04 09:25:37 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:37 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83eaa6f1-dfc1-4679-9f3f-569ee6b6551a" returned: 0 in 0.393s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-83eaa6f1-dfc1-4679-9f3f-569ee6b6551a" released by "_delete_snapshot" :: held 2.532s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" released by "delete_snapshot" :: held 2.575s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Created reservations ['82517517-6aa7-4851-8c2e-74b1a5d26a29', '25d3b87c-82df-46d3-941f-16230555c533', 'b3412988-500b-4047-b79e-d5e2afafb9d1', '71bcaa93-94fb-4ee2-ba16-55e2e90c8ca2'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:25:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Delete snapshot completed successfully.
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7c4afbb6-736a-42c4-9e54-f09a9869f688 tempest-SnapshotsActionsTest-950485607 None] Lock "cinder-83eaa6f1-dfc1-4679-9f3f-569ee6b6551a-delete_snapshot" released by "delete_snapshot" :: held 2.755s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:37 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e837271e-9349-4c95-a857-41466b9307c5" returned: 0 in 0.388s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Lock "cinder-quobyte-e837271e-9349-4c95-a857-41466b9307c5" released by "delete_volume" :: held 0.942s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:37 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Created reservations ['2f9c352e-f102-4a4c-a9f5-ed97f9d1d725', '69720cfb-b423-4f91-b8ba-f76a1ea951a8', '112da5a2-35f8-46bd-a578-835c3c47a7e9', '256e5dc5-4f95-47f1-8b9f-4db5f7431677'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:38 devstack sudo[99198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:25:38 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:38 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-864f43e2-4c26-45a8-814a-0cb1c4c5d756 tempest-ServerActionsTestOtherA-2089351963 None] Terminate volume connection completed successfully.
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-864f43e2-4c26-45a8-814a-0cb1c4c5d756 tempest-ServerActionsTestOtherA-2089351963 None] Deleting attachment 3cef7949-ac1d-4d08-bad5-6c33e9b8ee38. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:25:38 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.336s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:25:38 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Deleted volume successfully.
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5ce54c24-2449-45cb-a2ad-12e1669bea09 tempest-VolumeDependencyTests-893541767 None] Lock "cinder-e837271e-9349-4c95-a857-41466b9307c5-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "cinder-203a19a5-acbd-47db-9ec9-3a174fbaafa2-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Lock "cinder-203a19a5-acbd-47db-9ec9-3a174fbaafa2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "cinder-quobyte-203a19a5-acbd-47db-9ec9-3a174fbaafa2" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Lock "cinder-quobyte-203a19a5-acbd-47db-9ec9-3a174fbaafa2" acquired by "delete_volume" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9927e024-66b7-4c12-b4dd-1fe281b74234]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "cinder-83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Lock "cinder-83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "cinder-quobyte-83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Lock "cinder-quobyte-83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Deleting offline snapshot 83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 of volume 6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] snapshot_file for this snap is: volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6863dc5e-4e6d-40e7-af8a-a34f6e31397b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:39 devstack sudo[99201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2
Aug 04 09:25:39 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:39 devstack sudo[99203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:39 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:39 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2" returned: 0 in 0.816s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:39 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.601s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f86c425-eddd-49db-95db-4b06a1caeb7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac71d6f-ede5-4e3a-a140-2a85f7586f73]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:39 devstack sudo[99215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2
Aug 04 09:25:39 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:40 devstack sudo[99223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a
Aug 04 09:25:40 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "cinder-f6985265-129e-435f-b4b1-097b39621fb7-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Lock "cinder-f6985265-129e-435f-b4b1-097b39621fb7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "cinder-quobyte-f6985265-129e-435f-b4b1-097b39621fb7" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:40 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2" returned: 1 in 0.688s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Lock "cinder-quobyte-f6985265-129e-435f-b4b1-097b39621fb7" acquired by "delete_volume" :: waited 0.033s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:40 devstack sudo[99238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2
Aug 04 09:25:40 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd68c15a-8089-42e3-8f40-fd903a54a88a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:40 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a" returned: 0 in 0.718s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:40 devstack sudo[99242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:40 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:40 devstack sudo[99241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7
Aug 04 09:25:40 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:40 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-203a19a5-acbd-47db-9ec9-3a174fbaafa2" returned: 0 in 0.506s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Lock "cinder-quobyte-203a19a5-acbd-47db-9ec9-3a174fbaafa2" released by "delete_volume" :: held 2.163s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:41 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.508s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.quota [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Created reservations ['59141629-142d-4a47-9e08-c0c53d861f18', '54da35fe-55a1-432c-993b-47de96d29ab6', '8c1ee020-4abf-4d6f-be7f-186e5d61dd30', '85fba140-e816-4421-ba60-f0edefc6e1aa'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:25:41 devstack sudo[99252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9
Aug 04 09:25:41 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:41 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7" returned: 0 in 0.731s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:41 devstack sudo[99255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7
Aug 04 09:25:41 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:41 devstack sudo[99257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:25:41 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:41 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a.83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" returned: 0 in 0.489s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Lock "cinder-quobyte-83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9" released by "_delete_snapshot" :: held 2.543s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" released by "delete_snapshot" :: held 2.586s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:41 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6985265-129e-435f-b4b1-097b39621fb7" returned: 0 in 0.446s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Lock "cinder-quobyte-f6985265-129e-435f-b4b1-097b39621fb7" released by "delete_volume" :: held 1.245s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:41 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Created reservations ['bc0c1316-6540-4801-bbee-95077b60c08e', '4c050420-6275-469f-bdd6-2fd4dc5829a6', '9594a75c-0738-4400-9aa8-ce0259b2b43e', 'ee4c7e61-ffd1-432d-b7c8-38bb2162935b'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.420s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.manager [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:25:41 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Deleted volume successfully.
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Created reservations ['540af688-85bf-4b9b-bec1-82e1673e4045', 'b4eac439-f12d-4ae1-9d42-285944bc9533', 'b870aba6-5622-4eca-95bc-b1bd981db28c', '48453a3f-897b-458d-b928-41f7de9a1e83'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-492ef2fa-c358-4d2e-b2ea-97783ce8ee85 req-71c74055-6474-43de-abc5-861d8b8add92 tempest-ServerActionsTestOtherA-2089351963 None] Lock "cinder-203a19a5-acbd-47db-9ec9-3a174fbaafa2-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:41 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Delete snapshot completed successfully.
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-050c8f2c-d064-4af7-bf9a-ffea767ff624 tempest-SnapshotsActionsTest-1442451970 None] Lock "cinder-83e5c1c2-39a8-465e-bff5-e7eb7eaf82e9-delete_snapshot" released by "delete_snapshot" :: held 2.848s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:41 devstack sudo[99262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:25:41 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:42 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.355s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:42 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:25:42 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Deleted volume successfully.
Aug 04 09:25:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d82af449-a8ea-4fc5-ac67-7e828e1bcb3a tempest-ServerActionsTestOtherA-2089351963 None] Lock "cinder-f6985265-129e-435f-b4b1-097b39621fb7-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "cinder-6f86c425-eddd-49db-95db-4b06a1caeb7a-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Lock "cinder-6f86c425-eddd-49db-95db-4b06a1caeb7a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:25:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" acquired by "delete_volume" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:25:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[effe8535-1afb-4a41-9b88-f6d89fda2d0a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:25:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:42 devstack sudo[99273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a
Aug 04 09:25:42 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:43 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a" returned: 0 in 0.644s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:43 devstack sudo[99294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a
Aug 04 09:25:43 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:44 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f86c425-eddd-49db-95db-4b06a1caeb7a" returned: 0 in 0.628s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Lock "cinder-quobyte-6f86c425-eddd-49db-95db-4b06a1caeb7a" released by "delete_volume" :: held 1.391s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:44 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Created reservations ['f5d19325-ba6b-40ef-99ad-967461a2015f', '3d3e485d-5892-46af-8612-aadcd6eeedeb', 'f19d954e-ea94-4c8f-9902-b61cc4a7ba67', '9f986500-b789-4599-9464-843191dd9b50'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:25:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:25:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:25:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:25:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:25:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:25:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:25:44 devstack sudo[99335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:25:44 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:25:44 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root
Aug 04 09:25:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.443s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:25:44 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:25:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Deleted volume successfully.
Aug 04 09:25:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ecf8c5fb-e54f-480c-8ebe-e09f09cd1fd4 tempest-SnapshotsActionsTest-1442451970 None] Lock "cinder-6f86c425-eddd-49db-95db-4b06a1caeb7a-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:25:54 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=80,cinder:UPDATE=75,cinder:INSERT=20,cinder:DELETE=3 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:25:54 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=69,cinder:INSERT=22,cinder:UPDATE=82,cinder:DELETE=7 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Flow 'volume_create_manager' (a25f6747-5967-41cb-9497-72452acf3acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32383bd-2e56-41cc-90e5-d210d62796bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32383bd-2e56-41cc-90e5-d210d62796bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1988507334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122d73ea-4ea5-4825-a837-a9a3fc27370d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f11d1364354e3089c6a22add30d02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:03Z,use_quota=True,user_id='90fb48df9b924de6878c1ab283d0ac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ce7ede-e95f-4b6d-8dc6-9ddaf9683c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ce7ede-e95f-4b6d-8dc6-9ddaf9683c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72d86fb-c1d0-4bba-a66e-51f9274de87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72d86fb-c1d0-4bba-a66e-51f9274de87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '122d73ea-4ea5-4825-a837-a9a3fc27370d', 'volume_name': 'volume-122d73ea-4ea5-4825-a837-a9a3fc27370d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1341c3bd-d24d-4152-a211-8b91613338a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1341c3bd-d24d-4152-a211-8b91613338a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71cee215-0adb-4bee-a633-f58ce8b6fe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:02 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Volume 122d73ea-4ea5-4825-a837-a9a3fc27370d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-122d73ea-4ea5-4825-a837-a9a3fc27370d', 'volume_size': 1}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1988507334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122d73ea-4ea5-4825-a837-a9a3fc27370d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f11d1364354e3089c6a22add30d02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:03Z,use_quota=True,user_id='90fb48df9b924de6878c1ab283d0ac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Creating volume 122d73ea-4ea5-4825-a837-a9a3fc27370d {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:26:02 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:26:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-122d73ea-4ea5-4825-a837-a9a3fc27370d 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:02 devstack sudo[99435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-122d73ea-4ea5-4825-a837-a9a3fc27370d 1073741824
Aug 04 09:26:02 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:03 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-122d73ea-4ea5-4825-a837-a9a3fc27370d 1073741824" returned: 0 in 0.528s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-122d73ea-4ea5-4825-a837-a9a3fc27370d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:03 devstack sudo[99442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-122d73ea-4ea5-4825-a837-a9a3fc27370d
Aug 04 09:26:03 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:03 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-122d73ea-4ea5-4825-a837-a9a3fc27370d" returned: 0 in 0.271s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:26:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71cee215-0adb-4bee-a633-f58ce8b6fe6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122d73ea-4ea5-4825-a837-a9a3fc27370d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3844d5f6-1d6a-4bda-9df7-036e425ad848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:03 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Volume volume-122d73ea-4ea5-4825-a837-a9a3fc27370d (122d73ea-4ea5-4825-a837-a9a3fc27370d): created successfully
Aug 04 09:26:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3844d5f6-1d6a-4bda-9df7-036e425ad848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Flow 'volume_create_manager' (a25f6747-5967-41cb-9497-72452acf3acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:03 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-52521ea9-01c9-44c4-9cab-03cd675178e6 tempest-ProjectReaderTests-743364228 None] Created volume successfully.
Aug 04 09:26:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Acquiring lock "cinder-122d73ea-4ea5-4825-a837-a9a3fc27370d-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Lock "cinder-122d73ea-4ea5-4825-a837-a9a3fc27370d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Acquiring lock "cinder-quobyte-122d73ea-4ea5-4825-a837-a9a3fc27370d" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Lock "cinder-quobyte-122d73ea-4ea5-4825-a837-a9a3fc27370d" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:05 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3915b898-5116-4806-8437-1b689800a1b6]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-122d73ea-4ea5-4825-a837-a9a3fc27370d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:05 devstack sudo[99445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-122d73ea-4ea5-4825-a837-a9a3fc27370d
Aug 04 09:26:05 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:05 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-122d73ea-4ea5-4825-a837-a9a3fc27370d" returned: 0 in 0.577s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-122d73ea-4ea5-4825-a837-a9a3fc27370d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:05 devstack sudo[99450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-122d73ea-4ea5-4825-a837-a9a3fc27370d
Aug 04 09:26:05 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:06 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-122d73ea-4ea5-4825-a837-a9a3fc27370d" returned: 0 in 0.288s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Lock "cinder-quobyte-122d73ea-4ea5-4825-a837-a9a3fc27370d" released by "delete_volume" :: held 0.947s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:06 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Created reservations ['e1eefd70-0001-4f84-8888-033e286755ec', '6783b7f9-8395-4d1d-b88d-c56793ce9827', '716c0fb3-47aa-49e4-9e09-027b1e4960e7', 'aecf4ff9-5d6b-4bbc-82cc-cdc68c4425e6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:26:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:06 devstack sudo[99453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:26:06 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:06 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.292s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:06 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:26:06 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Deleted volume successfully.
Aug 04 09:26:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-20bc597f-833b-4863-9967-8c79e84857c7 tempest-ProjectReaderTests-743364228 None] Lock "cinder-122d73ea-4ea5-4825-a837-a9a3fc27370d-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:07 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:26:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Flow 'volume_create_manager' (8816b1b1-3ae6-490e-95f8-2756b940ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701dde18-0042-4597-8047-6fda6b6c79f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701dde18-0042-4597-8047-6fda6b6c79f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1893883611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d5051d-b98e-45c3-b19b-a6966a58d6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f11d1364354e3089c6a22add30d02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:08Z,use_quota=True,user_id='90fb48df9b924de6878c1ab283d0ac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe94c1b-d4a0-4cf7-8ac8-62102aa42954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe94c1b-d4a0-4cf7-8ac8-62102aa42954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc78bf25-a559-467a-b1ff-2e1be4ed5068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc78bf25-a559-467a-b1ff-2e1be4ed5068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3d5051d-b98e-45c3-b19b-a6966a58d6e8', 'volume_name': 'volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950b54a3-0837-477f-9dfe-6d6c5055c7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950b54a3-0837-477f-9dfe-6d6c5055c7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6c163c-03cd-4ada-9723-be73902202fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:08 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Volume c3d5051d-b98e-45c3-b19b-a6966a58d6e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8', 'volume_size': 1}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1893883611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d5051d-b98e-45c3-b19b-a6966a58d6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f11d1364354e3089c6a22add30d02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:08Z,use_quota=True,user_id='90fb48df9b924de6878c1ab283d0ac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Creating volume c3d5051d-b98e-45c3-b19b-a6966a58d6e8 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:26:08 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:08 devstack sudo[99457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8 1073741824
Aug 04 09:26:08 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:08 devstack sudo[99459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:26:08 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:08 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.402s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:26:08 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8 1073741824" returned: 0 in 0.549s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:08 devstack sudo[99466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8
Aug 04 09:26:08 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:08 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8" returned: 0 in 0.325s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6c163c-03cd-4ada-9723-be73902202fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c45d4e-ecc3-49cb-abaf-90e771dea4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:08 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Volume volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8 (c3d5051d-b98e-45c3-b19b-a6966a58d6e8): created successfully
Aug 04 09:26:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c45d4e-ecc3-49cb-abaf-90e771dea4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Flow 'volume_create_manager' (8816b1b1-3ae6-490e-95f8-2756b940ec58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:09 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f5630759-7ca8-4cea-a1d6-73a4ac6afb5c tempest-ProjectReaderTests-743364228 None] Created volume successfully.
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Acquiring lock "cinder-c3d5051d-b98e-45c3-b19b-a6966a58d6e8-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Lock "cinder-c3d5051d-b98e-45c3-b19b-a6966a58d6e8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Acquiring lock "cinder-quobyte-c3d5051d-b98e-45c3-b19b-a6966a58d6e8" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Lock "cinder-quobyte-c3d5051d-b98e-45c3-b19b-a6966a58d6e8" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[795077ba-f89a-47a1-ab9a-eaf56ba8d081]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:10 devstack sudo[99471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8
Aug 04 09:26:10 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:10 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8" returned: 0 in 0.373s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:10 devstack sudo[99476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8
Aug 04 09:26:10 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:10 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3d5051d-b98e-45c3-b19b-a6966a58d6e8" returned: 0 in 0.269s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Lock "cinder-quobyte-c3d5051d-b98e-45c3-b19b-a6966a58d6e8" released by "delete_volume" :: held 0.699s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Created reservations ['1de2baa1-6432-4ab7-a64a-63c9f4156045', 'edc91191-2fc1-4482-85ee-88d294d909dc', '303de675-dad0-40b7-9f1f-9c77ff056d3e', '0d5946b9-ee54-45a2-9ee0-388cf109a6b0'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:11 devstack sudo[99479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:26:11 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:11 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.291s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:26:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Deleted volume successfully.
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-80235230-fac4-4f43-91d3-be7458b732cf tempest-ProjectReaderTests-743364228 None] Lock "cinder-c3d5051d-b98e-45c3-b19b-a6966a58d6e8-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ac4be8f0-38de-4e13-846c-e06e1dffa2b6 tempest-GroupsV320Test-1607157814 None] Group tempest-GroupsV320Test-Group-1191707588: creating
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Flow 'volume_create_manager' (0a385f05-0013-433b-85af-92b6f0d3cdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e40eef-dfa1-4e28-95e7-679d51346c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ac4be8f0-38de-4e13-846c-e06e1dffa2b6 tempest-GroupsV320Test-1607157814 None] Group tempest-GroupsV320Test-Group-1191707588: created successfully
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e40eef-dfa1-4e28-95e7-679d51346c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-756358419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8944c68a-ea07-49c6-9411-ae801ef2ef31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f11d1364354e3089c6a22add30d02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:12Z,use_quota=True,user_id='90fb48df9b924de6878c1ab283d0ac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fec6388-c462-4e7b-a950-1b990a30173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fec6388-c462-4e7b-a950-1b990a30173c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a031c7-781c-4db3-a029-0d3a3d6dd1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a031c7-781c-4db3-a029-0d3a3d6dd1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8944c68a-ea07-49c6-9411-ae801ef2ef31', 'volume_name': 'volume-8944c68a-ea07-49c6-9411-ae801ef2ef31', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b385c971-b554-4c55-81fc-38655ee86d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b385c971-b554-4c55-81fc-38655ee86d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d58122e-b201-46b7-8105-f2409c7f7540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:11 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Volume 8944c68a-ea07-49c6-9411-ae801ef2ef31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8944c68a-ea07-49c6-9411-ae801ef2ef31', 'volume_size': 1}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-756358419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8944c68a-ea07-49c6-9411-ae801ef2ef31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f11d1364354e3089c6a22add30d02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:12Z,use_quota=True,user_id='90fb48df9b924de6878c1ab283d0ac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Creating volume 8944c68a-ea07-49c6-9411-ae801ef2ef31 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:26:11 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:26:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8944c68a-ea07-49c6-9411-ae801ef2ef31 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:12 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ac4be8f0-38de-4e13-846c-e06e1dffa2b6 tempest-GroupsV320Test-1607157814 None] Create group completed successfully.
Aug 04 09:26:12 devstack sudo[99482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8944c68a-ea07-49c6-9411-ae801ef2ef31 1073741824
Aug 04 09:26:12 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:12 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8944c68a-ea07-49c6-9411-ae801ef2ef31 1073741824" returned: 0 in 0.455s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8944c68a-ea07-49c6-9411-ae801ef2ef31 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:12 devstack sudo[99489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8944c68a-ea07-49c6-9411-ae801ef2ef31
Aug 04 09:26:12 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Flow 'volume_create_manager' (822c1860-6b34-4f36-83ca-4aedc776064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae25877-f672-40db-b24c-6e5148ea3c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae25877-f672-40db-b24c-6e5148ea3c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1995341694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812d6090-cec3-4534-92bd-c74f5459d812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d8f936fce74541a895b096fefe2929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:12Z,use_quota=True,user_id='a9f9184b31ff479aa2f346d8179aefb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cfdc26-5c4f-4666-96a3-4579773e3318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cfdc26-5c4f-4666-96a3-4579773e3318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e689ed6-08e0-41f4-b936-5166bf6fccf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e689ed6-08e0-41f4-b936-5166bf6fccf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '812d6090-cec3-4534-92bd-c74f5459d812', 'volume_name': 'volume-812d6090-cec3-4534-92bd-c74f5459d812', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9836f8e1-0e8a-45af-a42a-ee67345c2b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9836f8e1-0e8a-45af-a42a-ee67345c2b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8936583f-a1d5-444b-826b-efde2b1f2217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:12 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Volume 812d6090-cec3-4534-92bd-c74f5459d812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-812d6090-cec3-4534-92bd-c74f5459d812', 'volume_size': 1}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:12 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8944c68a-ea07-49c6-9411-ae801ef2ef31" returned: 0 in 0.229s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.123s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1995341694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812d6090-cec3-4534-92bd-c74f5459d812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d8f936fce74541a895b096fefe2929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:12Z,use_quota=True,user_id='a9f9184b31ff479aa2f346d8179aefb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Creating volume 812d6090-cec3-4534-92bd-c74f5459d812 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:26:12 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-812d6090-cec3-4534-92bd-c74f5459d812 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:12 devstack sudo[99492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-812d6090-cec3-4534-92bd-c74f5459d812 1073741824
Aug 04 09:26:12 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d58122e-b201-46b7-8105-f2409c7f7540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8944c68a-ea07-49c6-9411-ae801ef2ef31', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaa03dd3-8ebe-4159-87a5-7405bf35dbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:12 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Volume volume-8944c68a-ea07-49c6-9411-ae801ef2ef31 (8944c68a-ea07-49c6-9411-ae801ef2ef31): created successfully
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaa03dd3-8ebe-4159-87a5-7405bf35dbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Flow 'volume_create_manager' (0a385f05-0013-433b-85af-92b6f0d3cdd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:12 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-900a80f6-bcd7-4c27-af7a-389c799b6dff tempest-ProjectReaderTests-743364228 None] Created volume successfully.
Aug 04 09:26:13 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-812d6090-cec3-4534-92bd-c74f5459d812 1073741824" returned: 0 in 0.525s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-812d6090-cec3-4534-92bd-c74f5459d812 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:13 devstack sudo[99498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-812d6090-cec3-4534-92bd-c74f5459d812
Aug 04 09:26:13 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a25276e1-9471-4f62-b13d-84edebe6992b tempest-GroupsV320Test-1607157814 None] Created reservations ['ef0cd782-92c2-4cef-8ae8-967091f7a4fb'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a25276e1-9471-4f62-b13d-84edebe6992b tempest-GroupsV320Test-1607157814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a25276e1-9471-4f62-b13d-84edebe6992b tempest-GroupsV320Test-1607157814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a25276e1-9471-4f62-b13d-84edebe6992b tempest-GroupsV320Test-1607157814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a25276e1-9471-4f62-b13d-84edebe6992b tempest-GroupsV320Test-1607157814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a25276e1-9471-4f62-b13d-84edebe6992b tempest-GroupsV320Test-1607157814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a25276e1-9471-4f62-b13d-84edebe6992b tempest-GroupsV320Test-1607157814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:13 devstack sudo[99502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:26:13 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:13 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-812d6090-cec3-4534-92bd-c74f5459d812" returned: 0 in 0.280s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8936583f-a1d5-444b-826b-efde2b1f2217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-812d6090-cec3-4534-92bd-c74f5459d812', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0cf536-0beb-4f8b-b9cb-bec66b9cf4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:13 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Volume volume-812d6090-cec3-4534-92bd-c74f5459d812 (812d6090-cec3-4534-92bd-c74f5459d812): created successfully
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0cf536-0beb-4f8b-b9cb-bec66b9cf4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Flow 'volume_create_manager' (822c1860-6b34-4f36-83ca-4aedc776064b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2cf5c601-d7e6-4496-851a-6a91df9e237c tempest-VolumesServicesTestJSON-2084681562 None] Created volume successfully.
Aug 04 09:26:13 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a25276e1-9471-4f62-b13d-84edebe6992b tempest-GroupsV320Test-1607157814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.269s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:13 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-a25276e1-9471-4f62-b13d-84edebe6992b tempest-GroupsV320Test-1607157814 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:26:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a25276e1-9471-4f62-b13d-84edebe6992b tempest-GroupsV320Test-1607157814 None] Delete group completed successfully.
Aug 04 09:26:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Acquiring lock "cinder-8944c68a-ea07-49c6-9411-ae801ef2ef31-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Lock "cinder-8944c68a-ea07-49c6-9411-ae801ef2ef31-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Acquiring lock "cinder-quobyte-8944c68a-ea07-49c6-9411-ae801ef2ef31" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Lock "cinder-quobyte-8944c68a-ea07-49c6-9411-ae801ef2ef31" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:14 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8781e07d-f337-4644-8bb5-792acfedb03e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8944c68a-ea07-49c6-9411-ae801ef2ef31 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:14 devstack sudo[99510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8944c68a-ea07-49c6-9411-ae801ef2ef31
Aug 04 09:26:14 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:14 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8944c68a-ea07-49c6-9411-ae801ef2ef31" returned: 0 in 0.568s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8944c68a-ea07-49c6-9411-ae801ef2ef31 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:14 devstack sudo[99538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8944c68a-ea07-49c6-9411-ae801ef2ef31
Aug 04 09:26:14 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Acquiring lock "cinder-812d6090-cec3-4534-92bd-c74f5459d812-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Lock "cinder-812d6090-cec3-4534-92bd-c74f5459d812-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Acquiring lock "cinder-quobyte-812d6090-cec3-4534-92bd-c74f5459d812" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Lock "cinder-quobyte-812d6090-cec3-4534-92bd-c74f5459d812" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:15 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8944c68a-ea07-49c6-9411-ae801ef2ef31" returned: 0 in 0.409s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Lock "cinder-quobyte-8944c68a-ea07-49c6-9411-ae801ef2ef31" released by "delete_volume" :: held 1.040s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[99862854-f043-4f6b-b2bc-84e2b0f11a8e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-812d6090-cec3-4534-92bd-c74f5459d812 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Created reservations ['5472649d-7ae1-4327-a708-42747878ba8a', '504f3186-8a27-489e-9ce3-3141f90b824e', 'cd584964-5fcf-4cad-950c-54666a41a8e8', '2d22e689-f8fd-4558-824c-ba4a535fe813'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:26:15 devstack sudo[99542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-812d6090-cec3-4534-92bd-c74f5459d812
Aug 04 09:26:15 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:15 devstack sudo[99544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:26:15 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:15 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.305s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:26:15 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Deleted volume successfully.
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0387ae37-1b02-458d-8a37-673b8037981b tempest-ProjectReaderTests-743364228 None] Lock "cinder-8944c68a-ea07-49c6-9411-ae801ef2ef31-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:15 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-812d6090-cec3-4534-92bd-c74f5459d812" returned: 0 in 0.592s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-812d6090-cec3-4534-92bd-c74f5459d812 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:15 devstack sudo[99551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-812d6090-cec3-4534-92bd-c74f5459d812
Aug 04 09:26:15 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:16 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-812d6090-cec3-4534-92bd-c74f5459d812" returned: 0 in 0.290s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Lock "cinder-quobyte-812d6090-cec3-4534-92bd-c74f5459d812" released by "delete_volume" :: held 0.976s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Created reservations ['4c5b4450-9e16-4e16-83f2-40cabe27e6e6', 'dc9cc2ff-132e-490a-8cf1-1f20e085b763', '78582814-691b-4dfa-8ba3-c5b0ddadb184', '04d3395c-412c-435c-bf12-f283559b6fc1'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:16 devstack sudo[99555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:26:16 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:16 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.354s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:26:16 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Deleted volume successfully.
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-234aad92-3946-4676-9eec-1f74a4cc59b1 tempest-VolumesServicesTestJSON-2084681562 None] Lock "cinder-812d6090-cec3-4534-92bd-c74f5459d812-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Flow 'volume_create_manager' (d51a3ecd-2637-4908-bcfa-16cac2fdf097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd629512-d1ab-425a-be30-024efddb19a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd629512-d1ab-425a-be30-024efddb19a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305444202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e379d72-8e3b-4a76-9a5c-f15d7f770bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f11d1364354e3089c6a22add30d02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:17Z,use_quota=True,user_id='90fb48df9b924de6878c1ab283d0ac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725734a8-17be-4991-84e1-be4066d6e721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725734a8-17be-4991-84e1-be4066d6e721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b5ad46-e207-42de-9935-6c256195efea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b5ad46-e207-42de-9935-6c256195efea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e379d72-8e3b-4a76-9a5c-f15d7f770bb5', 'volume_name': 'volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844caf19-f261-45e1-b3e2-770f32993fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844caf19-f261-45e1-b3e2-770f32993fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d73359-cd76-4a41-b808-be64faa6931f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:16 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Volume 8e379d72-8e3b-4a76-9a5c-f15d7f770bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5', 'volume_size': 1}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305444202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e379d72-8e3b-4a76-9a5c-f15d7f770bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f11d1364354e3089c6a22add30d02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:17Z,use_quota=True,user_id='90fb48df9b924de6878c1ab283d0ac36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Creating volume 8e379d72-8e3b-4a76-9a5c-f15d7f770bb5 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:26:16 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:26:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:16 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5 1073741824
Aug 04 09:26:16 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:17 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5 1073741824" returned: 0 in 0.546s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:17 devstack sudo[99573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5
Aug 04 09:26:17 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:17 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5" returned: 0 in 0.313s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:26:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d73359-cd76-4a41-b808-be64faa6931f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958af254-c9e1-4e6d-992b-55098d2021ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:17 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Volume volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5 (8e379d72-8e3b-4a76-9a5c-f15d7f770bb5): created successfully
Aug 04 09:26:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958af254-c9e1-4e6d-992b-55098d2021ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Flow 'volume_create_manager' (d51a3ecd-2637-4908-bcfa-16cac2fdf097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:17 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-27743d3f-3913-47e7-96d4-80b0187c2ac8 tempest-ProjectReaderTests-743364228 None] Created volume successfully.
Aug 04 09:26:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Acquiring lock "cinder-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Lock "cinder-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Acquiring lock "cinder-quobyte-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Lock "cinder-quobyte-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5" acquired by "delete_volume" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:19 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[552eca94-ccea-43a1-a91f-5de4dd32e32d]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:19 devstack sudo[99579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5
Aug 04 09:26:19 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:19 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5" returned: 0 in 0.457s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:19 devstack sudo[99591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5
Aug 04 09:26:19 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:19 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-9204bd1a-d3df-4fd9-837a-83d4c5acd2a6 req-b9341a9a-3ee0-47e4-b3d4-9abe2807688b tempest-AttachVolumeNegativeTest-873513332 None] Terminate volume connection completed successfully.
Aug 04 09:26:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-9204bd1a-d3df-4fd9-837a-83d4c5acd2a6 req-b9341a9a-3ee0-47e4-b3d4-9abe2807688b tempest-AttachVolumeNegativeTest-873513332 None] Deleting attachment 970437b9-8ed4-40cd-afe8-7236412bfec5. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:26:20 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5" returned: 0 in 0.319s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Lock "cinder-quobyte-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5" released by "delete_volume" :: held 0.837s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:20 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Created reservations ['2d554ec3-68d4-430d-94d9-af7da3740024', '970a677d-dfb3-4d0f-9c07-3372ea7b7e67', '4119672e-431e-4ed8-93a5-78b1ffba7e5b', 'ffef841b-ca7b-4b69-bd5f-3d50c8dc3fdd'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:26:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:20 devstack sudo[99594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:26:20 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:20 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.465s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:20 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:26:20 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Deleted volume successfully.
Aug 04 09:26:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-70e04510-6723-4599-b981-c893531d24b3 tempest-ProjectReaderTests-743364228 None] Lock "cinder-8e379d72-8e3b-4a76-9a5c-f15d7f770bb5-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Flow 'volume_create_manager' (e20ae63d-5a79-4db8-a015-10d3440e92a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba80c819-412c-4189-bfb4-63972f5c6811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba80c819-412c-4189-bfb4-63972f5c6811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-473168550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65668313-8d48-4193-9f60-82bb72b5137d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2b2c09612844a7b1b7530a24b56fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:25Z,use_quota=True,user_id='fa3794d2d5cf4244af5d2accb02970be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093f3499-49ff-4d28-bcfc-69ca9d0668ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093f3499-49ff-4d28-bcfc-69ca9d0668ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e855ea2-5a59-4989-ad59-60f042b21455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e855ea2-5a59-4989-ad59-60f042b21455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65668313-8d48-4193-9f60-82bb72b5137d', 'volume_name': 'volume-65668313-8d48-4193-9f60-82bb72b5137d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49dc611c-9bac-44f5-9026-da1319629f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49dc611c-9bac-44f5-9026-da1319629f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d3d8e7-b062-444d-ae0d-1d7c5fcdc4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:25 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Volume 65668313-8d48-4193-9f60-82bb72b5137d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65668313-8d48-4193-9f60-82bb72b5137d', 'volume_size': 1}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-473168550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65668313-8d48-4193-9f60-82bb72b5137d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2b2c09612844a7b1b7530a24b56fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:25Z,use_quota=True,user_id='fa3794d2d5cf4244af5d2accb02970be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Creating volume 65668313-8d48-4193-9f60-82bb72b5137d {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:26:25 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:25 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d 1073741824
Aug 04 09:26:25 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:25 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d 1073741824" returned: 0 in 0.508s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:26 devstack sudo[99632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d
Aug 04 09:26:26 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:26 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d" returned: 0 in 0.282s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:26 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:26:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d3d8e7-b062-444d-ae0d-1d7c5fcdc4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65668313-8d48-4193-9f60-82bb72b5137d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e32f8405-052e-480d-bfac-9b0a03ecad4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:26 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Volume volume-65668313-8d48-4193-9f60-82bb72b5137d (65668313-8d48-4193-9f60-82bb72b5137d): created successfully
Aug 04 09:26:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e32f8405-052e-480d-bfac-9b0a03ecad4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Flow 'volume_create_manager' (e20ae63d-5a79-4db8-a015-10d3440e92a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:26 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1c8dea97-8585-4982-ab0c-6eac59d55e49 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Created volume successfully.
Aug 04 09:26:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Creating offline snapshot 1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb of volume 65668313-8d48-4193-9f60-82bb72b5137d {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:26:27 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2dc50d-50b7-4d08-bbef-f72f62faf973]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:27 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d
Aug 04 09:26:27 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:28 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d" returned: 0 in 0.401s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:28 devstack sudo[99642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb 1G
Aug 04 09:26:28 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:28 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb 1G" returned: 0 in 0.499s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65668313-8d48-4193-9f60-82bb72b5137d -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:28 devstack sudo[99651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65668313-8d48-4193-9f60-82bb72b5137d -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb
Aug 04 09:26:28 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:28 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65668313-8d48-4193-9f60-82bb72b5137d -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb" returned: 0 in 0.360s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:28 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb is being set with open permissions: ugo+rw
Aug 04 09:26:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:28 devstack sudo[99657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb
Aug 04 09:26:28 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:29 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb" returned: 0 in 0.264s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:29 devstack sudo[99660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.info
Aug 04 09:26:29 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:29 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.info" returned: 0 in 0.414s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:29 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.info is being set with open permissions: ugo+rw
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:29 devstack sudo[99664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.info
Aug 04 09:26:29 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Flow 'volume_create_manager' (fedf7620-eae9-4f27-8b3b-53103d2b23c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83e2587-d932-4948-a1c4-7f620bcd00d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83e2587-d932-4948-a1c4-7f620bcd00d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1337618934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f27dd5-3725-42a7-978b-45b4adfa4101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08163de822c427f896a89a5800324cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:30Z,use_quota=True,user_id='3e70efd93466402aa1da9bfa7955cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8f59b41-a672-4379-918c-abaafab960d9),volume_type_id=e8f59b41-a672-4379-918c-abaafab960d9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba575c87-fc1e-4c82-a348-bb8a2ee2b18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba575c87-fc1e-4c82-a348-bb8a2ee2b18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0dfe090-bffa-48b8-a7d0-233265f0bed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0dfe090-bffa-48b8-a7d0-233265f0bed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75f27dd5-3725-42a7-978b-45b4adfa4101', 'volume_name': 'volume-75f27dd5-3725-42a7-978b-45b4adfa4101', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e776808b-3f06-43e1-8427-c758d6b40121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e776808b-3f06-43e1-8427-c758d6b40121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c894dfd-955d-421b-8904-10cc67857d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:29 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Volume 75f27dd5-3725-42a7-978b-45b4adfa4101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75f27dd5-3725-42a7-978b-45b4adfa4101', 'volume_size': 1}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:29 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.info" returned: 0 in 0.294s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.360s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.146s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1337618934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f27dd5-3725-42a7-978b-45b4adfa4101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08163de822c427f896a89a5800324cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:30Z,use_quota=True,user_id='3e70efd93466402aa1da9bfa7955cc32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8f59b41-a672-4379-918c-abaafab960d9),volume_type_id=e8f59b41-a672-4379-918c-abaafab960d9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Creating volume 75f27dd5-3725-42a7-978b-45b4adfa4101 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:26:29 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:26:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-75f27dd5-3725-42a7-978b-45b4adfa4101 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:29 devstack sudo[99671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-75f27dd5-3725-42a7-978b-45b4adfa4101 1073741824
Aug 04 09:26:29 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:30 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-5ac81b49-3f30-4f29-991d-725fd84f7924 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Create snapshot completed successfully
Aug 04 09:26:30 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-75f27dd5-3725-42a7-978b-45b4adfa4101 1073741824" returned: 0 in 0.611s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-75f27dd5-3725-42a7-978b-45b4adfa4101 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:30 devstack sudo[99690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-75f27dd5-3725-42a7-978b-45b4adfa4101
Aug 04 09:26:30 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:30 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-75f27dd5-3725-42a7-978b-45b4adfa4101" returned: 0 in 0.263s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:26:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c894dfd-955d-421b-8904-10cc67857d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75f27dd5-3725-42a7-978b-45b4adfa4101', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b60adf-bf5e-4497-9e31-5421380f76d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Volume volume-75f27dd5-3725-42a7-978b-45b4adfa4101 (75f27dd5-3725-42a7-978b-45b4adfa4101): created successfully
Aug 04 09:26:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b60adf-bf5e-4497-9e31-5421380f76d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Flow 'volume_create_manager' (fedf7620-eae9-4f27-8b3b-53103d2b23c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:30 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e0b2adf3-0cf4-455c-9bcc-004ec13609e0 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Created volume successfully.
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Acquiring lock "cinder-1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "cinder-1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Acquiring lock "cinder-quobyte-65668313-8d48-4193-9f60-82bb72b5137d" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "cinder-quobyte-65668313-8d48-4193-9f60-82bb72b5137d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Acquiring lock "cinder-quobyte-1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "cinder-quobyte-1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Deleting offline snapshot 1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb of volume 65668313-8d48-4193-9f60-82bb72b5137d {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] snapshot_file for this snap is: volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[44816a71-0cf0-48a0-befb-ef0430d23239]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:31 devstack sudo[99693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb
Aug 04 09:26:31 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:31 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb" returned: 0 in 0.395s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65668313-8d48-4193-9f60-82bb72b5137d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab741eff-7e01-408c-96e1-0584d853c50f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:31 devstack sudo[99699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d
Aug 04 09:26:31 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2a5c58b3-d3b4-4508-b52a-a8533d827e01 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2a5c58b3-d3b4-4508-b52a-a8533d827e01 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2a5c58b3-d3b4-4508-b52a-a8533d827e01 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2a5c58b3-d3b4-4508-b52a-a8533d827e01 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2a5c58b3-d3b4-4508-b52a-a8533d827e01 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2a5c58b3-d3b4-4508-b52a-a8533d827e01 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:32 devstack sudo[99703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:26:32 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:32 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d" returned: 0 in 0.448s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:32 devstack sudo[99707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb
Aug 04 09:26:32 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:32 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2a5c58b3-d3b4-4508-b52a-a8533d827e01 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.531s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:32 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-2a5c58b3-d3b4-4508-b52a-a8533d827e01 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:26:32 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2a5c58b3-d3b4-4508-b52a-a8533d827e01 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Retype volume completed successfully.
Aug 04 09:26:32 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb" returned: 0 in 0.639s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:32 devstack sudo[99758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb
Aug 04 09:26:32 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:33 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d.1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb" returned: 0 in 0.433s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "cinder-quobyte-1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb" released by "_delete_snapshot" :: held 2.150s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "cinder-quobyte-65668313-8d48-4193-9f60-82bb72b5137d" released by "delete_snapshot" :: held 2.191s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:33 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Created reservations ['ed8ad29e-6c6f-4e52-a016-fc9a1d85b83e', '3d781699-7e16-4be6-b528-2486686b8578', '34e123c3-553b-411d-ab77-783e4642fb50', 'f6ddf190-0e80-4f61-8262-1a3d8f75970f'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:26:33 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Delete snapshot completed successfully.
Aug 04 09:26:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b357101f-6bdd-45dc-9bde-55707e7b2b56 tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "cinder-1d6d8f87-f344-4a2d-aa0e-4c8f24a0afdb-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Acquiring lock "cinder-75f27dd5-3725-42a7-978b-45b4adfa4101-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Lock "cinder-75f27dd5-3725-42a7-978b-45b4adfa4101-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Acquiring lock "cinder-quobyte-75f27dd5-3725-42a7-978b-45b4adfa4101" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Lock "cinder-quobyte-75f27dd5-3725-42a7-978b-45b4adfa4101" acquired by "delete_volume" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:33 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b3f023-4083-4f77-9252-9bf40eda699b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-75f27dd5-3725-42a7-978b-45b4adfa4101 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:33 devstack sudo[99798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-75f27dd5-3725-42a7-978b-45b4adfa4101
Aug 04 09:26:33 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:34 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-75f27dd5-3725-42a7-978b-45b4adfa4101" returned: 0 in 0.363s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-75f27dd5-3725-42a7-978b-45b4adfa4101 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:34 devstack sudo[99805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-75f27dd5-3725-42a7-978b-45b4adfa4101
Aug 04 09:26:34 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:34 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-75f27dd5-3725-42a7-978b-45b4adfa4101" returned: 0 in 0.254s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Lock "cinder-quobyte-75f27dd5-3725-42a7-978b-45b4adfa4101" released by "delete_volume" :: held 0.660s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:34 devstack cinder-volume[88880]: WARNING cinder.quota [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:26:34 devstack cinder-volume[88880]: WARNING cinder.quota [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Created reservations ['d04016b3-2064-41d2-875f-44e12d17d113', 'af43c5de-5d68-4f9f-8d6d-20ce21648160', '815c9283-2a4f-4200-8275-4b9ad5f27a33', 'f5613504-fa9b-4d9d-9e70-5a538b6117de'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:34 devstack sudo[99808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:26:34 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Acquiring lock "cinder-65668313-8d48-4193-9f60-82bb72b5137d-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "cinder-65668313-8d48-4193-9f60-82bb72b5137d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Acquiring lock "cinder-quobyte-65668313-8d48-4193-9f60-82bb72b5137d" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "cinder-quobyte-65668313-8d48-4193-9f60-82bb72b5137d" acquired by "delete_volume" :: waited 0.040s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5949b250-316b-4fd5-84a9-512630760fbf]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:34 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.344s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:26:34 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Deleted volume successfully.
Aug 04 09:26:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-31d27503-dfce-4825-aa7e-9b8f198c4016 tempest-VolumeRetypeWithoutMigrationTest-256583171 None] Lock "cinder-75f27dd5-3725-42a7-978b-45b4adfa4101-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:35 devstack sudo[99813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d
Aug 04 09:26:35 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:35 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d" returned: 0 in 0.597s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:35 devstack sudo[99818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d
Aug 04 09:26:35 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:35 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-65668313-8d48-4193-9f60-82bb72b5137d" returned: 0 in 0.254s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "cinder-quobyte-65668313-8d48-4193-9f60-82bb72b5137d" released by "delete_volume" :: held 1.011s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:35 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Created reservations ['b8cdf789-e4ff-436a-9996-a5d4cefc63d1', '8ecc8c74-f7a9-4bc7-84d8-f2400b222b25', '80c93833-c21b-45c9-a603-8a480ede7059', '59eb8b9d-622c-4d71-895a-8d73e6b40db3'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:26:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:35 devstack sudo[99829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:26:35 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:36 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.400s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:36 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:26:36 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Deleted volume successfully.
Aug 04 09:26:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-68393eda-e023-436a-ab25-05b3ec752fcd tempest-VolumeSnapshotQuotasNegativeTestJSON-392597138 None] Lock "cinder-65668313-8d48-4193-9f60-82bb72b5137d-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Flow 'volume_create_manager' (d0a9d6e5-6d75-49b7-9ff9-9e585cf11262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1f5ba6-8da8-4cf3-8f56-3e18e1dc5d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1f5ba6-8da8-4cf3-8f56-3e18e1dc5d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1065939059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213055cf-f359-4bb0-9aed-9f4b43226d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792c0b7ff4004f37b35531a17dccf178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:45Z,use_quota=True,user_id='8d6d29e012734391a0a2166f97aea42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46fa58d2-29fe-4c05-bb93-0bcba6ea7b86),volume_type_id=46fa58d2-29fe-4c05-bb93-0bcba6ea7b86)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f38d50-dfc1-4155-8595-a2823ccde266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f38d50-dfc1-4155-8595-a2823ccde266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1546edb-c198-4dd4-af70-3cf0000f36f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1546edb-c198-4dd4-af70-3cf0000f36f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '213055cf-f359-4bb0-9aed-9f4b43226d8f', 'volume_name': 'volume-213055cf-f359-4bb0-9aed-9f4b43226d8f', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f244c4cf-ad6f-4c41-9434-e48d029e8233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f244c4cf-ad6f-4c41-9434-e48d029e8233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d163d07-0e54-40a9-b734-ea4eb552afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:45 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Volume 213055cf-f359-4bb0-9aed-9f4b43226d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-213055cf-f359-4bb0-9aed-9f4b43226d8f', 'volume_size': 1}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1065939059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213055cf-f359-4bb0-9aed-9f4b43226d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792c0b7ff4004f37b35531a17dccf178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:45Z,use_quota=True,user_id='8d6d29e012734391a0a2166f97aea42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46fa58d2-29fe-4c05-bb93-0bcba6ea7b86),volume_type_id=46fa58d2-29fe-4c05-bb93-0bcba6ea7b86)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Creating volume 213055cf-f359-4bb0-9aed-9f4b43226d8f {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:26:45 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-213055cf-f359-4bb0-9aed-9f4b43226d8f 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:45 devstack sudo[99873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-213055cf-f359-4bb0-9aed-9f4b43226d8f 1073741824
Aug 04 09:26:45 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:45 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-213055cf-f359-4bb0-9aed-9f4b43226d8f 1073741824" returned: 0 in 0.480s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-213055cf-f359-4bb0-9aed-9f4b43226d8f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:45 devstack sudo[99879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-213055cf-f359-4bb0-9aed-9f4b43226d8f
Aug 04 09:26:45 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:46 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-213055cf-f359-4bb0-9aed-9f4b43226d8f" returned: 0 in 0.284s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:26:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d163d07-0e54-40a9-b734-ea4eb552afc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-213055cf-f359-4bb0-9aed-9f4b43226d8f', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2231b11b-3ccb-45a0-9301-fcc9177a68cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:46 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Volume volume-213055cf-f359-4bb0-9aed-9f4b43226d8f (213055cf-f359-4bb0-9aed-9f4b43226d8f): created successfully
Aug 04 09:26:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2231b11b-3ccb-45a0-9301-fcc9177a68cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Flow 'volume_create_manager' (d0a9d6e5-6d75-49b7-9ff9-9e585cf11262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:46 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-886d3e5a-193d-4126-a480-3248b22c0b48 tempest-VolumeTypesAccessTest-1783657615 None] Created volume successfully.
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Flow 'volume_create_manager' (c9847100-008e-462e-8dd7-aa71e824ebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5851c65-c7cb-4dec-ab06-ef8b7c237626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5851c65-c7cb-4dec-ab06-ef8b7c237626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-614857446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e875726-ac71-4cbc-9e9c-a5b013241dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9e6fdc8c047eeb92ea841bc4a5d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:47Z,use_quota=True,user_id='1b90c559b6f84d49a9cf6f9bf7188e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e60962c-4e52-4290-9096-f7d2feeafe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e60962c-4e52-4290-9096-f7d2feeafe5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef00f93-4b7a-4f43-a219-dc5ebf0c23e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.image.glance [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Creating Keystone auth plugin from conf {{(pid=88880) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Acquiring lock "cinder-213055cf-f359-4bb0-9aed-9f4b43226d8f-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Lock "cinder-213055cf-f359-4bb0-9aed-9f4b43226d8f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Acquiring lock "cinder-quobyte-213055cf-f359-4bb0-9aed-9f4b43226d8f" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Lock "cinder-quobyte-213055cf-f359-4bb0-9aed-9f4b43226d8f" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b335d1-5df2-4e40-99fa-9293437e66b7]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-213055cf-f359-4bb0-9aed-9f4b43226d8f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef00f93-4b7a-4f43-a219-dc5ebf0c23e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e875726-ac71-4cbc-9e9c-a5b013241dca', 'volume_name': 'volume-9e875726-ac71-4cbc-9e9c-a5b013241dca', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5db9fcf5f0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e990cce0-90aa-4f11-8b1f-4a3c91c9f94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e990cce0-90aa-4f11-8b1f-4a3c91c9f94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e5d7bf-a0f9-49fd-b0e6-370f66405622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:47 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Volume 9e875726-ac71-4cbc-9e9c-a5b013241dca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e875726-ac71-4cbc-9e9c-a5b013241dca', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5db9fcf5f0>}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Trying to clone 9e875726-ac71-4cbc-9e9c-a5b013241dca from image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]). {{(pid=88880) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 04 09:26:47 devstack sudo[99905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-213055cf-f359-4bb0-9aed-9f4b43226d8f
Aug 04 09:26:47 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 04 09:26:47 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Image download 20.69 MB at 20.69 MB/s
Aug 04 09:26:47 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-213055cf-f359-4bb0-9aed-9f4b43226d8f" returned: 0 in 0.399s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-213055cf-f359-4bb0-9aed-9f4b43226d8f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:47 devstack sudo[99911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-213055cf-f359-4bb0-9aed-9f4b43226d8f
Aug 04 09:26:47 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8176c900-fe3b-4c26-836a-2b0d97ecc232]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:47 devstack sudo[99913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD
Aug 04 09:26:47 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:48 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-213055cf-f359-4bb0-9aed-9f4b43226d8f" returned: 0 in 0.247s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Lock "cinder-quobyte-213055cf-f359-4bb0-9aed-9f4b43226d8f" released by "delete_volume" :: held 0.698s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:48 devstack cinder-volume[88880]: WARNING cinder.quota [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-99708214 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-99708214, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:26:48 devstack cinder-volume[88880]: WARNING cinder.quota [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-99708214 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-99708214, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Created reservations ['32e28b75-fbad-41dd-9f1b-e55c6dba6a8c', 'f971402e-2d73-4809-80ea-ca8798f747c4', '96f13cf5-df7a-4d4e-b836-2e44feca8602', '3790d1df-c621-4643-8e2f-847de585cc38'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:48 devstack sudo[99919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:26:48 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:48 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Temporary image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 is fetched for user 1b90c559b6f84d49a9cf6f9bf7188e80. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c25aff-a14f-47ad-852a-6b5f1b7d99c5]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:48 devstack sudo[99921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD
Aug 04 09:26:48 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:48 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.255s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:26:48 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Deleted volume successfully.
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-01895550-25de-4e9a-add9-31def7c3d854 tempest-VolumeTypesAccessTest-1783657615 None] Lock "cinder-213055cf-f359-4bb0-9aed-9f4b43226d8f-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:48 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-614857446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e875726-ac71-4cbc-9e9c-a5b013241dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9e6fdc8c047eeb92ea841bc4a5d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:47Z,use_quota=True,user_id='1b90c559b6f84d49a9cf6f9bf7188e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Creating volume 9e875726-ac71-4cbc-9e9c-a5b013241dca {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:26:48 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:26:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:48 devstack sudo[99927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca 1073741824
Aug 04 09:26:48 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:49 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca 1073741824" returned: 0 in 0.506s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:49 devstack sudo[99933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca
Aug 04 09:26:49 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:49 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca" returned: 0 in 0.251s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:26:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:49 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Attempting download of 3846a4df-9a56-4b6a-83ff-12d6b09a1144 ((None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}])) to volume 9e875726-ac71-4cbc-9e9c-a5b013241dca. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 04 09:26:49 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a622c-0bf4-46d2-be21-b5c63852f257]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_w16dvunr {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:49 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_w16dvunr
Aug 04 09:26:49 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:49 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_w16dvunr" returned: 0 in 0.327s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_w16dvunr {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:49 devstack sudo[99941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_w16dvunr
Aug 04 09:26:49 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:50 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_w16dvunr" returned: 1 in 0.336s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_w16dvunr' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:26:50 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[28742913-be26-41e4-80b7-9af29bbf02b5]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:50 devstack sudo[99945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD
Aug 04 09:26:50 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:50 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:50 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] 3846a4df-9a56-4b6a-83ff-12d6b09a1144 was qcow2, converting to raw {{(pid=88880) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 04 09:26:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:50 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca
Aug 04 09:26:50 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:52 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca" returned: 0 in 1.565s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:52 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_q99zdo2ddevstack@QuobyteHD, size 112.00 MB, duration 1.57 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:26:52 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Converted 112.00 MB image at 71.49 MB/s
Aug 04 09:26:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:52 devstack sudo[99966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca 1G
Aug 04 09:26:52 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:52 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca 1G" returned: 0 in 0.318s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:52 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7979e51-4238-4410-a81c-0fa791138b65]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:52 devstack sudo[99971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca
Aug 04 09:26:52 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:52 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca" returned: 0 in 0.381s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:52 devstack sudo[99975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca
Aug 04 09:26:52 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:53 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca" returned: 1 in 0.373s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:26:53 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Downloaded image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 ((None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}])) to volume 9e875726-ac71-4cbc-9e9c-a5b013241dca successfully. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 04 09:26:53 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Temporary image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 for user 1b90c559b6f84d49a9cf6f9bf7188e80 is deleted. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 04 09:26:53 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Marking volume 9e875726-ac71-4cbc-9e9c-a5b013241dca as bootable. {{(pid=88880) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 04 09:26:53 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Copying metadata from image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 to 9e875726-ac71-4cbc-9e9c-a5b013241dca. {{(pid=88880) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 04 09:26:53 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Creating volume glance metadata for volume 9e875726-ac71-4cbc-9e9c-a5b013241dca backed by image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88880) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 04 09:26:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e5d7bf-a0f9-49fd-b0e6-370f66405622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e875726-ac71-4cbc-9e9c-a5b013241dca', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5db9fcf5f0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90dbd65-73c1-40bb-a732-0f9d480f85c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:53 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Volume volume-9e875726-ac71-4cbc-9e9c-a5b013241dca (9e875726-ac71-4cbc-9e9c-a5b013241dca): created successfully
Aug 04 09:26:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90dbd65-73c1-40bb-a732-0f9d480f85c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Flow 'volume_create_manager' (c9847100-008e-462e-8dd7-aa71e824ebd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:53 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e8e7e131-90ea-456a-abeb-2049f16d7787 tempest-VolumesImageMetadata-2066383903 None] Created volume successfully.
Aug 04 09:26:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Acquiring lock "cinder-9e875726-ac71-4cbc-9e9c-a5b013241dca-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Lock "cinder-9e875726-ac71-4cbc-9e9c-a5b013241dca-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:54 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=90,cinder:UPDATE=97,cinder:INSERT=27,cinder:DELETE=11 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:26:54 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=119,cinder:SELECT=90,cinder:DELETE=7,cinder:INSERT=33 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:26:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Acquiring lock "cinder-quobyte-9e875726-ac71-4cbc-9e9c-a5b013241dca" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:26:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Lock "cinder-quobyte-9e875726-ac71-4cbc-9e9c-a5b013241dca" acquired by "delete_volume" :: waited 0.041s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:26:54 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbd0617-e0bd-4350-be39-b4f5430a5db2]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:26:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:55 devstack sudo[99980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca
Aug 04 09:26:55 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:55 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca" returned: 0 in 0.383s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:55 devstack sudo[99984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca
Aug 04 09:26:55 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:55 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca" returned: 1 in 0.345s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:26:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:55 devstack sudo[99989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca
Aug 04 09:26:55 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:55 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9e875726-ac71-4cbc-9e9c-a5b013241dca" returned: 0 in 0.248s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Lock "cinder-quobyte-9e875726-ac71-4cbc-9e9c-a5b013241dca" released by "delete_volume" :: held 1.043s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:56 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Created reservations ['25f33b67-7a54-4f19-af83-886998152dc0', '32051ebe-8be4-49ab-b35d-1260d5bc7cb2', '00dfbcfb-3bc7-4c8d-8545-84b8c9f2676e', '888018ce-efbe-4866-b458-4ef81bb5c74c'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:26:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:56 devstack sudo[99992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:26:56 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:56 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.255s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:56 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:26:56 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Deleted volume successfully.
Aug 04 09:26:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c794d05c-ab85-4c03-acf0-9607da86457d tempest-VolumesImageMetadata-2066383903 None] Lock "cinder-9e875726-ac71-4cbc-9e9c-a5b013241dca-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Flow 'volume_create_manager' (ba359987-39cc-42d4-a1d2-d7eb183ca5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1809d1c-1ea9-4bfd-9dd1-022f40a7850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1809d1c-1ea9-4bfd-9dd1-022f40a7850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1347292474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1e7505-d612-4917-bac2-b0a0bb1a8441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f571bcb56d34bd0b339eaf94802a9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:59Z,use_quota=True,user_id='2b2f063fcaef4e4aaaf3d0ab7bbf1d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb9b081-e578-4295-af7f-9e725654aa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb9b081-e578-4295-af7f-9e725654aa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773ae076-cbf7-4c86-bf03-0ca2b8975b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773ae076-cbf7-4c86-bf03-0ca2b8975b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb1e7505-d612-4917-bac2-b0a0bb1a8441', 'volume_name': 'volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9907db-65c1-4d00-87fa-699d9cbca759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9907db-65c1-4d00-87fa-699d9cbca759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6068bb11-3f26-40b9-9623-e31f32ff4703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:58 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Volume cb1e7505-d612-4917-bac2-b0a0bb1a8441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441', 'volume_size': 1}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1347292474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1e7505-d612-4917-bac2-b0a0bb1a8441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f571bcb56d34bd0b339eaf94802a9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:26:59Z,use_quota=True,user_id='2b2f063fcaef4e4aaaf3d0ab7bbf1d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Creating volume cb1e7505-d612-4917-bac2-b0a0bb1a8441 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:26:58 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:26:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:58 devstack sudo[99997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441 1073741824
Aug 04 09:26:58 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:59 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441 1073741824" returned: 0 in 0.504s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:26:59 devstack sudo[100003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441
Aug 04 09:26:59 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:26:59 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root
Aug 04 09:26:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441" returned: 0 in 0.285s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:26:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:26:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:26:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6068bb11-3f26-40b9-9623-e31f32ff4703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01ccb7a-c7da-4edb-88af-d37d38ec4f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:26:59 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Volume volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441 (cb1e7505-d612-4917-bac2-b0a0bb1a8441): created successfully
Aug 04 09:26:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01ccb7a-c7da-4edb-88af-d37d38ec4f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:26:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Flow 'volume_create_manager' (ba359987-39cc-42d4-a1d2-d7eb183ca5e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:26:59 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-78b0c9ba-5838-4072-9541-968bf7e3868c tempest-AttachVolumeNegativeTest-873513332 None] Created volume successfully.
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Flow 'volume_create_manager' (03edb466-cca7-4a23-9054-d226aa7a4c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a2284c-90ff-4615-972b-8f23f9dfb631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a2284c-90ff-4615-972b-8f23f9dfb631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1774371149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bf3be2-858e-4f7c-9468-10b26d6e3022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7708e38ea8494b8bade9c312670af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:01Z,use_quota=True,user_id='8569e84e4e3942bbb29e6ba3dd4f8d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1d64e4-b636-4bf5-bebd-1a2d9ccadac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1d64e4-b636-4bf5-bebd-1a2d9ccadac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5414d5-62a7-4fee-ac83-e15b81cbc22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5414d5-62a7-4fee-ac83-e15b81cbc22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4bf3be2-858e-4f7c-9468-10b26d6e3022', 'volume_name': 'volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5851ed60-28ef-4d3d-bf87-6a18e4b805e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5851ed60-28ef-4d3d-bf87-6a18e4b805e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67704cd4-f6a0-4c66-9ac7-fcbdd4b15aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:01 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Volume d4bf3be2-858e-4f7c-9468-10b26d6e3022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022', 'volume_size': 1}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1774371149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bf3be2-858e-4f7c-9468-10b26d6e3022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7708e38ea8494b8bade9c312670af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:01Z,use_quota=True,user_id='8569e84e4e3942bbb29e6ba3dd4f8d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Creating volume d4bf3be2-858e-4f7c-9468-10b26d6e3022 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:27:01 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:01 devstack sudo[100018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022 1073741824
Aug 04 09:27:01 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-21b3c5bb-7fe9-44b8-b997-6e1ecf83fdae req-e2f33be7-5aae-4f57-97b6-9221ee200778 tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:01 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022 1073741824" returned: 0 in 0.430s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:01 devstack sudo[100024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022
Aug 04 09:27:01 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:02 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022" returned: 0 in 0.256s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-21b3c5bb-7fe9-44b8-b997-6e1ecf83fdae req-e2f33be7-5aae-4f57-97b6-9221ee200778 tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.625s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67704cd4-f6a0-4c66-9ac7-fcbdd4b15aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae87cacf-fb68-4beb-b7d1-a80756d232b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8580b418-3652-4eb9-8d9a-6ece189befaa]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-21b3c5bb-7fe9-44b8-b997-6e1ecf83fdae req-e2f33be7-5aae-4f57-97b6-9221ee200778 tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:02 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Volume volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022 (d4bf3be2-858e-4f7c-9468-10b26d6e3022): created successfully
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae87cacf-fb68-4beb-b7d1-a80756d232b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Flow 'volume_create_manager' (03edb466-cca7-4a23-9054-d226aa7a4c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:02 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-0806aa0a-0af1-4c6a-888c-ddb4ba63f94f tempest-AbsoluteLimitsTests-643328737 None] Created volume successfully.
Aug 04 09:27:02 devstack sudo[100027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441
Aug 04 09:27:02 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:02 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-21b3c5bb-7fe9-44b8-b997-6e1ecf83fdae req-e2f33be7-5aae-4f57-97b6-9221ee200778 tempest-AttachVolumeNegativeTest-873513332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441" returned: 0 in 0.401s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-21b3c5bb-7fe9-44b8-b997-6e1ecf83fdae req-e2f33be7-5aae-4f57-97b6-9221ee200778 tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.443s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-21b3c5bb-7fe9-44b8-b997-6e1ecf83fdae req-e2f33be7-5aae-4f57-97b6-9221ee200778 tempest-AttachVolumeNegativeTest-873513332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c98fc3c-d92f-4be7-b915-2c749fe9b791', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:27:02 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-21b3c5bb-7fe9-44b8-b997-6e1ecf83fdae req-e2f33be7-5aae-4f57-97b6-9221ee200778 tempest-AttachVolumeNegativeTest-873513332 None] attachment_update completed successfully.
Aug 04 09:27:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Acquiring lock "cinder-d4bf3be2-858e-4f7c-9468-10b26d6e3022-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Lock "cinder-d4bf3be2-858e-4f7c-9468-10b26d6e3022-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Acquiring lock "cinder-quobyte-d4bf3be2-858e-4f7c-9468-10b26d6e3022" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Lock "cinder-quobyte-d4bf3be2-858e-4f7c-9468-10b26d6e3022" acquired by "delete_volume" :: waited 0.040s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:03 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06429c2-d6fc-491c-9129-f562efe4ee56]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:03 devstack sudo[100418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022
Aug 04 09:27:03 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:04 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022" returned: 0 in 0.456s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:04 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022
Aug 04 09:27:04 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:04 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d4bf3be2-858e-4f7c-9468-10b26d6e3022" returned: 0 in 0.244s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Lock "cinder-quobyte-d4bf3be2-858e-4f7c-9468-10b26d6e3022" released by "delete_volume" :: held 0.771s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Created reservations ['fb58c0ce-0cc2-4902-b807-36b7dc8d9440', '9a082e4d-929e-4baa-a420-f880661be92e', '57ff6d44-e1ec-478a-85d8-5a074901ccd4', '62ae3f28-9752-44f4-bff8-3c22225b63da'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:04 devstack sudo[100426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:27:04 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:04 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.329s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:27:04 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Deleted volume successfully.
Aug 04 09:27:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-04733690-b2e6-4af1-a52c-18877ced66a4 tempest-AbsoluteLimitsTests-643328737 None] Lock "cinder-d4bf3be2-858e-4f7c-9468-10b26d6e3022-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:05 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-19f9d080-c309-456a-a8eb-e32ab84d0cfd req-e41ace0e-f4c1-4756-b8ba-dd621f4d10dd tempest-AttachVolumeNegativeTest-873513332 None] Terminate volume connection completed successfully.
Aug 04 09:27:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-19f9d080-c309-456a-a8eb-e32ab84d0cfd req-e41ace0e-f4c1-4756-b8ba-dd621f4d10dd tempest-AttachVolumeNegativeTest-873513332 None] Deleting attachment 6c98fc3c-d92f-4be7-b915-2c749fe9b791. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:27:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:27:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:08 devstack sudo[100481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:27:08 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:08 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.331s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:27:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:27:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:27:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Flow 'volume_create_manager' (f7ec2431-34df-426d-9957-ba9b697676c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d37021-9bf8-4daa-9f65-1f0d1d059742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d37021-9bf8-4daa-9f65-1f0d1d059742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-245501363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3451756-5f35-4bba-b3bd-061edccb6798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8e3abdddf14594860d198f28983067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:10Z,use_quota=True,user_id='1a8bc0e7e15b4fb5bf3ed97fe2049b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ff3f9f-a4b5-4bc0-99b9-ded88a786094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ff3f9f-a4b5-4bc0-99b9-ded88a786094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f135a0-1e53-4460-9363-543d4bc46de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f135a0-1e53-4460-9363-543d4bc46de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3451756-5f35-4bba-b3bd-061edccb6798', 'volume_name': 'volume-d3451756-5f35-4bba-b3bd-061edccb6798', 'volume_size': 2}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fd3f41-46d4-4e8c-aa2c-49a9f1325f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fd3f41-46d4-4e8c-aa2c-49a9f1325f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6d6a4b-3537-4ca2-a5ad-daaeb92aa93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:10 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Volume d3451756-5f35-4bba-b3bd-061edccb6798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3451756-5f35-4bba-b3bd-061edccb6798', 'volume_size': 2}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-245501363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3451756-5f35-4bba-b3bd-061edccb6798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8e3abdddf14594860d198f28983067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:10Z,use_quota=True,user_id='1a8bc0e7e15b4fb5bf3ed97fe2049b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Creating volume d3451756-5f35-4bba-b3bd-061edccb6798 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:27:10 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:27:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d3451756-5f35-4bba-b3bd-061edccb6798 2147483648 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:10 devstack sudo[100489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d3451756-5f35-4bba-b3bd-061edccb6798 2147483648
Aug 04 09:27:10 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:11 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d3451756-5f35-4bba-b3bd-061edccb6798 2147483648" returned: 0 in 0.718s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d3451756-5f35-4bba-b3bd-061edccb6798 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:11 devstack sudo[100495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d3451756-5f35-4bba-b3bd-061edccb6798
Aug 04 09:27:11 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:11 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d3451756-5f35-4bba-b3bd-061edccb6798" returned: 0 in 0.265s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:27:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6d6a4b-3537-4ca2-a5ad-daaeb92aa93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3451756-5f35-4bba-b3bd-061edccb6798', 'volume_size': 2}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e69afbc-be81-4bda-8c0d-f76bc2320592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:11 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Volume volume-d3451756-5f35-4bba-b3bd-061edccb6798 (d3451756-5f35-4bba-b3bd-061edccb6798): created successfully
Aug 04 09:27:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e69afbc-be81-4bda-8c0d-f76bc2320592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Flow 'volume_create_manager' (f7ec2431-34df-426d-9957-ba9b697676c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6839bf78-0422-4328-986c-65c2d4d175c0 tempest-VolumesCloneNegativeTest-1853896515 None] Created volume successfully.
Aug 04 09:27:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Acquiring lock "cinder-d3451756-5f35-4bba-b3bd-061edccb6798-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Lock "cinder-d3451756-5f35-4bba-b3bd-061edccb6798-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Acquiring lock "cinder-quobyte-d3451756-5f35-4bba-b3bd-061edccb6798" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Lock "cinder-quobyte-d3451756-5f35-4bba-b3bd-061edccb6798" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:12 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e5df59-c1c1-45ca-9431-2a73652f0883]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d3451756-5f35-4bba-b3bd-061edccb6798 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:12 devstack sudo[100498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d3451756-5f35-4bba-b3bd-061edccb6798
Aug 04 09:27:12 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:13 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d3451756-5f35-4bba-b3bd-061edccb6798" returned: 0 in 0.408s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d3451756-5f35-4bba-b3bd-061edccb6798 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:13 devstack sudo[100503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d3451756-5f35-4bba-b3bd-061edccb6798
Aug 04 09:27:13 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:13 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d3451756-5f35-4bba-b3bd-061edccb6798" returned: 0 in 0.266s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Lock "cinder-quobyte-d3451756-5f35-4bba-b3bd-061edccb6798" released by "delete_volume" :: held 0.728s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Created reservations ['ca774641-dcd5-48d8-be79-b8975174c9f6', '7f5432fe-980c-48a4-b096-61db1df4e4dc', '66b38cc4-c0c8-4b11-b5fc-301c5a2617e4', 'e86e07a9-c970-46d0-9890-467b978960e0'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:13 devstack sudo[100506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:27:13 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:13 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.301s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:27:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Deleted volume successfully.
Aug 04 09:27:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f991764e-23fe-4470-96bd-5c27ee0c370d tempest-VolumesCloneNegativeTest-1853896515 None] Lock "cinder-d3451756-5f35-4bba-b3bd-061edccb6798-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (e78ed9e7-b757-461c-be01-d47a7ea11e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c5fcc7-09fe-411e-b6c0-1ae9c1dba297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c5fcc7-09fe-411e-b6c0-1ae9c1dba297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-760524789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3635cd95-05ba-4f05-b330-fb94f7878df8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:17Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef11cdb-cafa-4177-9fcd-87fbed7dfa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef11cdb-cafa-4177-9fcd-87fbed7dfa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4ed2e8-e869-4929-a33b-fd4657ff702f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4ed2e8-e869-4929-a33b-fd4657ff702f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3635cd95-05ba-4f05-b330-fb94f7878df8', 'volume_name': 'volume-3635cd95-05ba-4f05-b330-fb94f7878df8', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97619767-dee6-4fd4-9853-2cfa7abe1725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97619767-dee6-4fd4-9853-2cfa7abe1725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b9d1d1-b0f6-4a5c-86eb-0aeacc10811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:17 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Volume 3635cd95-05ba-4f05-b330-fb94f7878df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3635cd95-05ba-4f05-b330-fb94f7878df8', 'volume_size': 1}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-760524789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3635cd95-05ba-4f05-b330-fb94f7878df8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:17Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Creating volume 3635cd95-05ba-4f05-b330-fb94f7878df8 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:27:17 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:27:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3635cd95-05ba-4f05-b330-fb94f7878df8 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:17 devstack sudo[100519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3635cd95-05ba-4f05-b330-fb94f7878df8 1073741824
Aug 04 09:27:17 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:18 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3635cd95-05ba-4f05-b330-fb94f7878df8 1073741824" returned: 0 in 0.580s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3635cd95-05ba-4f05-b330-fb94f7878df8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:18 devstack sudo[100534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3635cd95-05ba-4f05-b330-fb94f7878df8
Aug 04 09:27:18 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:18 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3635cd95-05ba-4f05-b330-fb94f7878df8" returned: 0 in 0.385s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:27:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b9d1d1-b0f6-4a5c-86eb-0aeacc10811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3635cd95-05ba-4f05-b330-fb94f7878df8', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec61126-f888-4249-ab08-5f51ad129e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:18 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Volume volume-3635cd95-05ba-4f05-b330-fb94f7878df8 (3635cd95-05ba-4f05-b330-fb94f7878df8): created successfully
Aug 04 09:27:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec61126-f888-4249-ab08-5f51ad129e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (e78ed9e7-b757-461c-be01-d47a7ea11e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:18 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9eed79d1-0687-43e7-add1-3c08ef2ea00e tempest-VolumesGetTest-1618516292 None] Created volume successfully.
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (e06f1cbb-ff2c-4a18-97be-1681c6311ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5428767b-db9e-4d1c-80df-ffa8d6902031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5428767b-db9e-4d1c-80df-ffa8d6902031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2132612697',display_name='tempest-VolumesGetTest-Volume-1399956569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aaa92fe-52d3-4078-965c-b9ec13e0c927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:21Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc0f72b-6ad9-4a65-9239-e13434235893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc0f72b-6ad9-4a65-9239-e13434235893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60ce8af-1272-4f48-926f-3469756fa4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60ce8af-1272-4f48-926f-3469756fa4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aaa92fe-52d3-4078-965c-b9ec13e0c927', 'volume_name': 'volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff091a5-dfad-4fa4-89e7-ed3ac50f923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff091a5-dfad-4fa4-89e7-ed3ac50f923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b552747-6f4f-4ad8-9ad9-5e62ea2f2c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:20 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Volume 5aaa92fe-52d3-4078-965c-b9ec13e0c927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927', 'volume_size': 1}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2132612697',display_name='tempest-VolumesGetTest-Volume-1399956569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aaa92fe-52d3-4078-965c-b9ec13e0c927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:21Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Creating volume 5aaa92fe-52d3-4078-965c-b9ec13e0c927 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:27:20 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:27:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:20 devstack sudo[100538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927 1073741824
Aug 04 09:27:20 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:21 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927 1073741824" returned: 0 in 0.681s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:21 devstack sudo[100544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927
Aug 04 09:27:21 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:21 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927" returned: 0 in 0.383s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:27:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:22 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b552747-6f4f-4ad8-9ad9-5e62ea2f2c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:22 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6124226f-b6ea-4b0a-ac91-1bb16d8fa864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:22 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Volume volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927 (5aaa92fe-52d3-4078-965c-b9ec13e0c927): created successfully
Aug 04 09:27:22 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6124226f-b6ea-4b0a-ac91-1bb16d8fa864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:22 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (e06f1cbb-ff2c-4a18-97be-1681c6311ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:22 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1e2c882d-d04b-4008-a03c-83fb346814b4 tempest-VolumesGetTest-1618516292 None] Created volume successfully.
Aug 04 09:27:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-5aaa92fe-52d3-4078-965c-b9ec13e0c927-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Lock "cinder-5aaa92fe-52d3-4078-965c-b9ec13e0c927-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-quobyte-5aaa92fe-52d3-4078-965c-b9ec13e0c927" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-5aaa92fe-52d3-4078-965c-b9ec13e0c927" acquired by "delete_volume" :: waited 0.030s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:23 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2c99db-4ac2-4e30-9e64-ce16e24ef155]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:23 devstack sudo[100601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927
Aug 04 09:27:23 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:23 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927" returned: 0 in 0.601s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:23 devstack sudo[100629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927
Aug 04 09:27:23 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:24 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5aaa92fe-52d3-4078-965c-b9ec13e0c927" returned: 0 in 0.291s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-5aaa92fe-52d3-4078-965c-b9ec13e0c927" released by "delete_volume" :: held 0.999s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:24 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Created reservations ['538b41a1-5c47-472c-91bc-dc8bb42d79ca', '2a3fb8d3-4eaf-481b-b323-710a6c47fece', '2a9b8e0c-cf91-4d5e-9b58-154a67853e61', 'cf0e19d5-631d-43f6-85d2-91ca5543b0a5'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:27:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:24 devstack sudo[100640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:27:24 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:24 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.336s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:24 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:27:24 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Deleted volume successfully.
Aug 04 09:27:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2fdd3efa-6f38-4f53-801a-04f748b8e4c2 tempest-VolumesGetTest-1618516292 None] Lock "cinder-5aaa92fe-52d3-4078-965c-b9ec13e0c927-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-3635cd95-05ba-4f05-b330-fb94f7878df8-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Lock "cinder-3635cd95-05ba-4f05-b330-fb94f7878df8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-quobyte-3635cd95-05ba-4f05-b330-fb94f7878df8" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-3635cd95-05ba-4f05-b330-fb94f7878df8" acquired by "delete_volume" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:25 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef76b17f-9054-4d86-9577-0cdc38737c3f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3635cd95-05ba-4f05-b330-fb94f7878df8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:26 devstack sudo[100660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3635cd95-05ba-4f05-b330-fb94f7878df8
Aug 04 09:27:26 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:26 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3635cd95-05ba-4f05-b330-fb94f7878df8" returned: 0 in 0.664s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3635cd95-05ba-4f05-b330-fb94f7878df8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:26 devstack sudo[100671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3635cd95-05ba-4f05-b330-fb94f7878df8
Aug 04 09:27:26 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:26 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-3635cd95-05ba-4f05-b330-fb94f7878df8" returned: 0 in 0.342s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-3635cd95-05ba-4f05-b330-fb94f7878df8" released by "delete_volume" :: held 1.096s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:26 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Created reservations ['20330584-be13-43aa-97ff-c90fa357eb4c', '21d5f68c-7803-4393-93ca-8b57d1e7006b', '95574532-c073-4460-bb02-6ca2eb4d3dc7', 'd9d49947-56af-46e3-879a-8855e493b941'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:27:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:27 devstack sudo[100674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:27:27 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:27 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.343s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:27 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:27:27 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Deleted volume successfully.
Aug 04 09:27:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ed7122f2-69ed-462b-a9cf-54c91e219308 tempest-VolumesGetTest-1618516292 None] Lock "cinder-3635cd95-05ba-4f05-b330-fb94f7878df8-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (66ded15a-2db4-4c41-9de5-563b37f339ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0425c01-ca4e-4716-8a22-4fb57bdad974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0425c01-ca4e-4716-8a22-4fb57bdad974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-712007030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8a6e08-07cf-40dd-9b7f-03a58e47223b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:29Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16bc0efa-c159-46d5-aaa0-e582946dba67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16bc0efa-c159-46d5-aaa0-e582946dba67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3b403e-5533-4987-92f5-50b78b9a2f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3b403e-5533-4987-92f5-50b78b9a2f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d8a6e08-07cf-40dd-9b7f-03a58e47223b', 'volume_name': 'volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5870eec1-b8f1-444e-a951-955a7b3a971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5870eec1-b8f1-444e-a951-955a7b3a971e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bd1f56-0bd4-48ea-830f-d3b9cc97ccec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:28 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Volume 9d8a6e08-07cf-40dd-9b7f-03a58e47223b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b', 'volume_size': 1}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-712007030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8a6e08-07cf-40dd-9b7f-03a58e47223b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:29Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Creating volume 9d8a6e08-07cf-40dd-9b7f-03a58e47223b {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:27:28 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:27:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:28 devstack sudo[100682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b 1073741824
Aug 04 09:27:28 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:29 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b 1073741824" returned: 0 in 0.944s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:29 devstack sudo[100733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b
Aug 04 09:27:29 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:30 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b" returned: 0 in 0.577s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:27:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bd1f56-0bd4-48ea-830f-d3b9cc97ccec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b89049b-7280-4a6b-acb0-4f724e8d1396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Volume volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b (9d8a6e08-07cf-40dd-9b7f-03a58e47223b): created successfully
Aug 04 09:27:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b89049b-7280-4a6b-acb0-4f724e8d1396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (66ded15a-2db4-4c41-9de5-563b37f339ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:30 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e072b5e0-4e9a-421f-ac5b-5c0093881948 tempest-VolumesGetTest-1618516292 None] Created volume successfully.
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (ac418f02-a749-436d-8007-0a6ba1a416b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256935f3-8aac-414a-8702-640714b5b4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256935f3-8aac-414a-8702-640714b5b4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1369363351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c180ff-79ef-4d50-83b1-7a648315cde0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=9d8a6e08-07cf-40dd-9b7f-03a58e47223b,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:31Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00c2cbf-f409-4ff2-b81b-892c41300041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00c2cbf-f409-4ff2-b81b-892c41300041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff68f61-62f9-40d0-a56b-49fe92408457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff68f61-62f9-40d0-a56b-49fe92408457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e1c180ff-79ef-4d50-83b1-7a648315cde0', 'volume_name': 'volume-e1c180ff-79ef-4d50-83b1-7a648315cde0', 'volume_size': 1, 'source_volid': '9d8a6e08-07cf-40dd-9b7f-03a58e47223b', 'source_volstatus': 'available'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c931cb7-69ef-4e01-83d6-4b2dd47f061a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c931cb7-69ef-4e01-83d6-4b2dd47f061a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6140e789-29cf-4eb6-b4f5-f3e011451dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:31 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Volume e1c180ff-79ef-4d50-83b1-7a648315cde0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e1c180ff-79ef-4d50-83b1-7a648315cde0', 'volume_size': 1, 'source_volid': '9d8a6e08-07cf-40dd-9b7f-03a58e47223b', 'source_volstatus': 'available'}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:31 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Cloning volume 9d8a6e08-07cf-40dd-9b7f-03a58e47223b to volume e1c180ff-79ef-4d50-83b1-7a648315cde0
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Creating offline snapshot 576feb6a-5809-4da2-973b-2a432c393202 of volume 9d8a6e08-07cf-40dd-9b7f-03a58e47223b {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fb49a7-ae5d-49c4-aecb-88fccca5abc3]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:31 devstack sudo[100775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b
Aug 04 09:27:31 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:32 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b" returned: 0 in 0.580s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:32 devstack sudo[100782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202 1G
Aug 04 09:27:32 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:32 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202 1G" returned: 0 in 0.558s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:32 devstack sudo[100788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202
Aug 04 09:27:32 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:33 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202" returned: 0 in 0.396s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:33 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202 is being set with open permissions: ugo+rw
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:33 devstack sudo[100793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202
Aug 04 09:27:33 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Flow 'volume_create_manager' (acf4e14b-7cd5-40e0-8bc4-f7e0b59d6759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8631a13-d4da-4802-a1b5-d6e681266bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:33 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202" returned: 0 in 0.341s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8631a13-d4da-4802-a1b5-d6e681266bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1743951516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07eb1ebb-e747-442b-8d86-afcf99fe23a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734ed69a5974d86940fea1ef736eee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:33Z,use_quota=True,user_id='032b1559e06d4e5fa4cddb813106a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48274316-7d97-4823-8ed2-5ea569b763db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48274316-7d97-4823-8ed2-5ea569b763db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48441fe0-a208-4654-9e7a-da0be6c3eba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48441fe0-a208-4654-9e7a-da0be6c3eba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07eb1ebb-e747-442b-8d86-afcf99fe23a5', 'volume_name': 'volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a05497-dcfb-4afe-9bc4-6a71deb22238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a05497-dcfb-4afe-9bc4-6a71deb22238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbba02c8-ea5f-485d-8e2f-b9de7bf5e029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:33 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Volume 07eb1ebb-e747-442b-8d86-afcf99fe23a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5', 'volume_size': 1}
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:33 devstack sudo[100796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.info
Aug 04 09:27:33 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:33 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.info" returned: 0 in 0.258s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:33 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.info is being set with open permissions: ugo+rw
Aug 04 09:27:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:34 devstack sudo[100799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.info
Aug 04 09:27:34 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:34 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.info" returned: 0 in 0.262s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-quobyte-e1c180ff-79ef-4d50-83b1-7a648315cde0" by "_copy_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-e1c180ff-79ef-4d50-83b1-7a648315cde0" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] snapshot: 576feb6a-5809-4da2-973b-2a432c393202, volume: e1c180ff-79ef-4d50-83b1-7a648315cde0,  {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcc28dd-a505-486c-9f26-56ebb0eb2f4a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:34 devstack sudo[100802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202
Aug 04 09:27:34 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:34 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202" returned: 0 in 0.415s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Creating direct copy from snapshot {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f19ea91-3f32-4b8b-a90f-b01b1aba2f8a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:34 devstack sudo[100807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b
Aug 04 09:27:34 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:35 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b" returned: 0 in 0.394s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:35 devstack cinder-volume[88880]: DEBUG cinder.utils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Path /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0 not found in is_blk_device check {{(pid=88880) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 04 09:27:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:35 devstack sudo[100812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0
Aug 04 09:27:35 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:41 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0" returned: 0 in 6.046s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:41 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f652b70e-ec28-4b30-ba58-0600be9825ce]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:41 devstack sudo[100885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b
Aug 04 09:27:41 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:41 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b" returned: 0 in 0.503s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:41 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:27:41 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Converted 1024.00 MB image at 169.33 MB/s
Aug 04 09:27:41 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0 is being set with open permissions: ugo+rw
Aug 04 09:27:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:41 devstack sudo[100890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0
Aug 04 09:27:41 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:41 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0" returned: 0 in 0.236s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-e1c180ff-79ef-4d50-83b1-7a648315cde0" released by "_copy_volume_from_snapshot" :: held 7.678s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-quobyte-576feb6a-5809-4da2-973b-2a432c393202" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-576feb6a-5809-4da2-973b-2a432c393202" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Deleting offline snapshot 576feb6a-5809-4da2-973b-2a432c393202 of volume 9d8a6e08-07cf-40dd-9b7f-03a58e47223b {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:27:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] snapshot_file for this snap is: volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:27:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f240b71-2865-4379-9316-1c0175f81ba8]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:42 devstack sudo[100893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202
Aug 04 09:27:42 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:42 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202" returned: 0 in 0.340s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:27:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26396cd-910d-4c4e-9d12-d66f6a481425]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:42 devstack sudo[100898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b
Aug 04 09:27:42 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:42 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b" returned: 0 in 0.395s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:42 devstack sudo[100903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202
Aug 04 09:27:42 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:43 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202" returned: 0 in 0.319s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:43 devstack sudo[100908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202
Aug 04 09:27:43 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:43 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b.576feb6a-5809-4da2-973b-2a432c393202" returned: 0 in 0.247s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-576feb6a-5809-4da2-973b-2a432c393202" released by "_delete_snapshot" :: held 1.406s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.802s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.820s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1743951516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07eb1ebb-e747-442b-8d86-afcf99fe23a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734ed69a5974d86940fea1ef736eee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:33Z,use_quota=True,user_id='032b1559e06d4e5fa4cddb813106a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Creating volume 07eb1ebb-e747-442b-8d86-afcf99fe23a5 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:27:43 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:43 devstack sudo[100911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5 1073741824
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6140e789-29cf-4eb6-b4f5-f3e011451dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c180ff-79ef-4d50-83b1-7a648315cde0', 'volume_size': 1, 'source_volid': '9d8a6e08-07cf-40dd-9b7f-03a58e47223b', 'source_volstatus': 'available'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:43 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf320a0-6af2-4c66-b0d4-b8c94789f5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:43 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Volume volume-e1c180ff-79ef-4d50-83b1-7a648315cde0 (e1c180ff-79ef-4d50-83b1-7a648315cde0): created successfully
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf320a0-6af2-4c66-b0d4-b8c94789f5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (ac418f02-a749-436d-8007-0a6ba1a416b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:43 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-03ad5d78-55ec-4c2d-bf55-75072263ef45 tempest-VolumesGetTest-1618516292 None] Created volume successfully.
Aug 04 09:27:43 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5 1073741824" returned: 0 in 0.499s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:44 devstack sudo[100916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5
Aug 04 09:27:44 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:44 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5" returned: 0 in 0.323s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbba02c8-ea5f-485d-8e2f-b9de7bf5e029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ac1a0b-a9ec-428e-91b6-7e63ddec9a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:44 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Volume volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5 (07eb1ebb-e747-442b-8d86-afcf99fe23a5): created successfully
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ac1a0b-a9ec-428e-91b6-7e63ddec9a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Flow 'volume_create_manager' (acf4e14b-7cd5-40e0-8bc4-f7e0b59d6759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-79af19ae-9845-48c9-8067-f3b13d909f3c tempest-VolumesActionsTest-1040140805 None] Created volume successfully.
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b493231e-f20b-4152-bf13-e2688e945510 tempest-VolumesActionsTest-1040140805 None] Acquiring lock "cinder-07eb1ebb-e747-442b-8d86-afcf99fe23a5" by "attach_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b493231e-f20b-4152-bf13-e2688e945510 tempest-VolumesActionsTest-1040140805 None] Lock "cinder-07eb1ebb-e747-442b-8d86-afcf99fe23a5" acquired by "attach_volume" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b493231e-f20b-4152-bf13-e2688e945510 tempest-VolumesActionsTest-1040140805 None] Attaching volume 07eb1ebb-e747-442b-8d86-afcf99fe23a5 to instance f471fc0a-6e1f-4166-8825-708f48787444 at mountpoint /dev/vdb on host None.
Aug 04 09:27:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b493231e-f20b-4152-bf13-e2688e945510 tempest-VolumesActionsTest-1040140805 None] Attach volume completed successfully.
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b493231e-f20b-4152-bf13-e2688e945510 tempest-VolumesActionsTest-1040140805 None] Lock "cinder-07eb1ebb-e747-442b-8d86-afcf99fe23a5" released by "attach_volume" :: held 0.115s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (d556372e-3ef5-44c2-aaac-6d8f171d68f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abe1c36-f5e7-46d3-b1fe-f962a6dbe4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abe1c36-f5e7-46d3-b1fe-f962a6dbe4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1588139851',display_name='tempest-VolumesGetTest-Volume-2005287954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b61ebf-86d1-402e-a627-5af1a4792183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:45Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091cacf8-cd6f-481e-89e9-582830d26674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091cacf8-cd6f-481e-89e9-582830d26674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b1c084-cefd-4ee3-bed9-cdad567ea80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b1c084-cefd-4ee3-bed9-cdad567ea80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b61ebf-86d1-402e-a627-5af1a4792183', 'volume_name': 'volume-f5b61ebf-86d1-402e-a627-5af1a4792183', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae8ab62-479b-420f-8847-4192d8bc24bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae8ab62-479b-420f-8847-4192d8bc24bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc1829-b03c-4346-ad13-0b72ea319630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:44 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Volume f5b61ebf-86d1-402e-a627-5af1a4792183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b61ebf-86d1-402e-a627-5af1a4792183', 'volume_size': 1}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1588139851',display_name='tempest-VolumesGetTest-Volume-2005287954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b61ebf-86d1-402e-a627-5af1a4792183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:45Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Creating volume f5b61ebf-86d1-402e-a627-5af1a4792183 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:27:44 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:27:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f5b61ebf-86d1-402e-a627-5af1a4792183 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:45 devstack sudo[100951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f5b61ebf-86d1-402e-a627-5af1a4792183 1073741824
Aug 04 09:27:45 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:45 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2794139e-1ac9-445f-8663-9504677c2163 tempest-VolumesActionsTest-2097163006 None] Terminate volume connection completed successfully.
Aug 04 09:27:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2794139e-1ac9-445f-8663-9504677c2163 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "cinder-07eb1ebb-e747-442b-8d86-afcf99fe23a5-detach_volume" by "detach_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2794139e-1ac9-445f-8663-9504677c2163 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-07eb1ebb-e747-442b-8d86-afcf99fe23a5-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:45 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2794139e-1ac9-445f-8663-9504677c2163 tempest-VolumesActionsTest-2097163006 None] Detaching volume 07eb1ebb-e747-442b-8d86-afcf99fe23a5 from instance f471fc0a-6e1f-4166-8825-708f48787444.
Aug 04 09:27:45 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2794139e-1ac9-445f-8663-9504677c2163 tempest-VolumesActionsTest-2097163006 None] Detach volume completed successfully.
Aug 04 09:27:45 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f5b61ebf-86d1-402e-a627-5af1a4792183 1073741824" returned: 0 in 0.576s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2794139e-1ac9-445f-8663-9504677c2163 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-07eb1ebb-e747-442b-8d86-afcf99fe23a5-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f5b61ebf-86d1-402e-a627-5af1a4792183 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:45 devstack sudo[100960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f5b61ebf-86d1-402e-a627-5af1a4792183
Aug 04 09:27:45 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6dfc675f-2391-4044-829f-0bc97f44e3da tempest-VolumesActionsTest-1040140805 None] Acquiring lock "cinder-07eb1ebb-e747-442b-8d86-afcf99fe23a5-detach_volume" by "detach_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6dfc675f-2391-4044-829f-0bc97f44e3da tempest-VolumesActionsTest-1040140805 None] Lock "cinder-07eb1ebb-e747-442b-8d86-afcf99fe23a5-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:45 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6dfc675f-2391-4044-829f-0bc97f44e3da tempest-VolumesActionsTest-1040140805 None] Volume detach called, but volume not attached.
Aug 04 09:27:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6dfc675f-2391-4044-829f-0bc97f44e3da tempest-VolumesActionsTest-1040140805 None] Lock "cinder-07eb1ebb-e747-442b-8d86-afcf99fe23a5-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:45 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f5b61ebf-86d1-402e-a627-5af1a4792183" returned: 0 in 0.366s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:27:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc1829-b03c-4346-ad13-0b72ea319630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b61ebf-86d1-402e-a627-5af1a4792183', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00e02f8-3ad1-45da-8cab-5eef228ca5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:46 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Volume volume-f5b61ebf-86d1-402e-a627-5af1a4792183 (f5b61ebf-86d1-402e-a627-5af1a4792183): created successfully
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00e02f8-3ad1-45da-8cab-5eef228ca5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (d556372e-3ef5-44c2-aaac-6d8f171d68f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:46 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-54418089-8704-4583-97f3-c640956c8155 tempest-VolumesGetTest-1618516292 None] Created volume successfully.
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Acquiring lock "cinder-07eb1ebb-e747-442b-8d86-afcf99fe23a5-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Lock "cinder-07eb1ebb-e747-442b-8d86-afcf99fe23a5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Acquiring lock "cinder-quobyte-07eb1ebb-e747-442b-8d86-afcf99fe23a5" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Lock "cinder-quobyte-07eb1ebb-e747-442b-8d86-afcf99fe23a5" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e244d3-a75e-431f-9e1d-8ef7b5c1588b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:46 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5
Aug 04 09:27:46 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:46 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5" returned: 0 in 0.354s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:46 devstack sudo[100968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5
Aug 04 09:27:46 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:46 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-07eb1ebb-e747-442b-8d86-afcf99fe23a5" returned: 0 in 0.251s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Lock "cinder-quobyte-07eb1ebb-e747-442b-8d86-afcf99fe23a5" released by "delete_volume" :: held 0.647s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Created reservations ['17eb4eb0-f06c-4b42-bb52-b91e0b6a63a3', '7763a98b-9d09-418b-81df-e32852e13e50', '1c0972a6-48b3-46ad-8b3f-de9b25026829', '499dfc74-fb6b-4bac-8625-eea510c61c23'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:47 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:27:47 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-f5b61ebf-86d1-402e-a627-5af1a4792183-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Lock "cinder-f5b61ebf-86d1-402e-a627-5af1a4792183-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-quobyte-f5b61ebf-86d1-402e-a627-5af1a4792183" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-f5b61ebf-86d1-402e-a627-5af1a4792183" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:47 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b245c495-137f-41eb-82dd-d3f08d5ae112]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f5b61ebf-86d1-402e-a627-5af1a4792183 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:47 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.332s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:47 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:27:47 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Deleted volume successfully.
Aug 04 09:27:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-589f5f1a-a9b1-4e22-b640-0cf98624f975 tempest-VolumesActionsTest-1040140805 None] Lock "cinder-07eb1ebb-e747-442b-8d86-afcf99fe23a5-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:47 devstack sudo[100974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f5b61ebf-86d1-402e-a627-5af1a4792183
Aug 04 09:27:47 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:47 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f5b61ebf-86d1-402e-a627-5af1a4792183" returned: 0 in 0.437s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f5b61ebf-86d1-402e-a627-5af1a4792183 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:47 devstack sudo[100986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f5b61ebf-86d1-402e-a627-5af1a4792183
Aug 04 09:27:47 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:48 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f5b61ebf-86d1-402e-a627-5af1a4792183" returned: 0 in 0.363s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-f5b61ebf-86d1-402e-a627-5af1a4792183" released by "delete_volume" :: held 0.855s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Created reservations ['f2c8448e-52b0-4ae2-aba6-21f992aa16a4', '89e88a16-39a1-42fa-8865-56bfd3fdbaa0', '7a7ebe5d-12af-4841-8caa-3ebd020e234b', '75715aa6-9755-4103-b7ed-1ae934547401'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:48 devstack sudo[101009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:27:48 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-e1c180ff-79ef-4d50-83b1-7a648315cde0-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Lock "cinder-e1c180ff-79ef-4d50-83b1-7a648315cde0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Flow 'volume_create_manager' (3d7a4636-8336-4634-8b28-b66df4a37f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401bddc6-e9c3-4a20-ace8-e50ee78a34e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-quobyte-e1c180ff-79ef-4d50-83b1-7a648315cde0" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401bddc6-e9c3-4a20-ace8-e50ee78a34e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2000649777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67222a7b-2843-4adf-bc4d-15485daf00a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f571bcb56d34bd0b339eaf94802a9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:49Z,use_quota=True,user_id='2b2f063fcaef4e4aaaf3d0ab7bbf1d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2449dc-b2cc-4633-921b-6dcfe06c84cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2449dc-b2cc-4633-921b-6dcfe06c84cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c306343b-20e3-4e76-891d-a0fee1560cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c306343b-20e3-4e76-891d-a0fee1560cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67222a7b-2843-4adf-bc4d-15485daf00a2', 'volume_name': 'volume-67222a7b-2843-4adf-bc4d-15485daf00a2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938d3e5d-b614-4f4c-8183-9d2d296bf8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938d3e5d-b614-4f4c-8183-9d2d296bf8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327b03d9-8b4d-44fa-89f2-5007a2ea1a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:48 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Volume 67222a7b-2843-4adf-bc4d-15485daf00a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67222a7b-2843-4adf-bc4d-15485daf00a2', 'volume_size': 1}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2000649777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67222a7b-2843-4adf-bc4d-15485daf00a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f571bcb56d34bd0b339eaf94802a9a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:49Z,use_quota=True,user_id='2b2f063fcaef4e4aaaf3d0ab7bbf1d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Creating volume 67222a7b-2843-4adf-bc4d-15485daf00a2 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:48 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:27:48 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.436s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:27:48 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Deleted volume successfully.
Aug 04 09:27:48 devstack sudo[101013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2 1073741824
Aug 04 09:27:48 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-e1c180ff-79ef-4d50-83b1-7a648315cde0" acquired by "delete_volume" :: waited 0.109s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d201a2b-f1a6-4ac1-bcae-08bf80fd1004]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c81d2cd-7010-40c5-9d60-17000565e894 tempest-VolumesGetTest-1618516292 None] Lock "cinder-f5b61ebf-86d1-402e-a627-5af1a4792183-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:48 devstack sudo[101015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0
Aug 04 09:27:48 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:49 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0" returned: 0 in 0.505s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:49 devstack sudo[101025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0
Aug 04 09:27:49 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:49 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2 1073741824" returned: 0 in 0.682s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:49 devstack sudo[101028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2
Aug 04 09:27:49 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:49 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e1c180ff-79ef-4d50-83b1-7a648315cde0" returned: 0 in 0.319s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-e1c180ff-79ef-4d50-83b1-7a648315cde0" released by "delete_volume" :: held 0.887s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Created reservations ['d9ae9d68-7680-42b6-852c-5b22427a646f', 'd92fbdb7-72b5-461b-beb8-df748f8143c0', '71b6c36c-5fe2-4969-86f1-4183db814e8f', '9edb141e-6b6a-4e32-b1b0-f9f005eb396b'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:27:49 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2" returned: 0 in 0.294s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327b03d9-8b4d-44fa-89f2-5007a2ea1a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67222a7b-2843-4adf-bc4d-15485daf00a2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f55fd40-b113-4d92-a906-2fc4aded5e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:49 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Volume volume-67222a7b-2843-4adf-bc4d-15485daf00a2 (67222a7b-2843-4adf-bc4d-15485daf00a2): created successfully
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f55fd40-b113-4d92-a906-2fc4aded5e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Flow 'volume_create_manager' (3d7a4636-8336-4634-8b28-b66df4a37f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:49 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3389f591-1e57-4b19-af34-920fd175dd7b tempest-AttachVolumeNegativeTest-873513332 None] Created volume successfully.
Aug 04 09:27:49 devstack sudo[101033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:27:49 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:50 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.254s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:27:50 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Deleted volume successfully.
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0a48e357-edb7-4791-b112-9dcd5533fd45 tempest-VolumesGetTest-1618516292 None] Lock "cinder-e1c180ff-79ef-4d50-83b1-7a648315cde0-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Flow 'volume_create_manager' (13464b9d-4c31-4a43-aa6c-a48ce5b4e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab070c73-aa6d-4fd5-b5fb-fe82e100506d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab070c73-aa6d-4fd5-b5fb-fe82e100506d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1592957856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f957017-299b-49bd-9dcc-7fa2d82cadeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734ed69a5974d86940fea1ef736eee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:51Z,use_quota=True,user_id='032b1559e06d4e5fa4cddb813106a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b3e255-8025-48d9-a4bd-c3de4fe40ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b3e255-8025-48d9-a4bd-c3de4fe40ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f46e69-1f6c-4334-a5b1-bd9be6fd0ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f46e69-1f6c-4334-a5b1-bd9be6fd0ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f957017-299b-49bd-9dcc-7fa2d82cadeb', 'volume_name': 'volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79b8bf1-c2e0-4079-8ee2-d0187123b9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79b8bf1-c2e0-4079-8ee2-d0187123b9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2288d63-4b4c-47ed-9b4f-c8a520ff24e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:50 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Volume 4f957017-299b-49bd-9dcc-7fa2d82cadeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb', 'volume_size': 1}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1592957856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f957017-299b-49bd-9dcc-7fa2d82cadeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734ed69a5974d86940fea1ef736eee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:51Z,use_quota=True,user_id='032b1559e06d4e5fa4cddb813106a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Creating volume 4f957017-299b-49bd-9dcc-7fa2d82cadeb {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:27:50 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-9d8a6e08-07cf-40dd-9b7f-03a58e47223b-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Lock "cinder-9d8a6e08-07cf-40dd-9b7f-03a58e47223b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:50 devstack sudo[101039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb 1073741824
Aug 04 09:27:50 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-quobyte-9d8a6e08-07cf-40dd-9b7f-03a58e47223b" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-9d8a6e08-07cf-40dd-9b7f-03a58e47223b" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c113c48-51e7-4c59-8709-1cf2e82bc2ad]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:51 devstack sudo[101041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b
Aug 04 09:27:51 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:51 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb 1073741824" returned: 0 in 0.602s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:51 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b" returned: 0 in 0.518s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:51 devstack sudo[101058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb
Aug 04 09:27:51 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-c90fe3e3-db59-471b-b482-0ed33f83ee0d req-2d7e541d-d432-4dc5-b2c3-99f3601f9fa5 tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:51 devstack sudo[101059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b
Aug 04 09:27:51 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:51 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:51 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb" returned: 0 in 0.302s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-c90fe3e3-db59-471b-b482-0ed33f83ee0d req-2d7e541d-d432-4dc5-b2c3-99f3601f9fa5 tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.266s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d8a6e08-07cf-40dd-9b7f-03a58e47223b" returned: 0 in 0.295s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37a10f7-6ca5-4958-9578-f7f79109604e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-c90fe3e3-db59-471b-b482-0ed33f83ee0d req-2d7e541d-d432-4dc5-b2c3-99f3601f9fa5 tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2288d63-4b4c-47ed-9b4f-c8a520ff24e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5bb2a9d-73da-469e-a266-3663355c828e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-9d8a6e08-07cf-40dd-9b7f-03a58e47223b" released by "delete_volume" :: held 0.914s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:51 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Volume volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb (4f957017-299b-49bd-9dcc-7fa2d82cadeb): created successfully
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5bb2a9d-73da-469e-a266-3663355c828e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Flow 'volume_create_manager' (13464b9d-4c31-4a43-aa6c-a48ce5b4e745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:51 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-23629d81-710c-4715-b2ca-0c2ecbfebc62 tempest-VolumesActionsTest-1040140805 None] Created volume successfully.
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Created reservations ['67b31d19-2f46-4c62-af7e-d4db8f84464c', '16073edf-9a61-455c-a1e4-e5c5d8f8916c', 'e65180e9-fb5c-4a29-9902-d8e29d2e46c2', 'a044242c-4c7a-41e9-9303-1652155094c3'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:27:52 devstack sudo[101064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2
Aug 04 09:27:52 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:52 devstack sudo[101073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:27:52 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:52 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-c90fe3e3-db59-471b-b482-0ed33f83ee0d req-2d7e541d-d432-4dc5-b2c3-99f3601f9fa5 tempest-AttachVolumeNegativeTest-873513332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2" returned: 0 in 0.449s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-c90fe3e3-db59-471b-b482-0ed33f83ee0d req-2d7e541d-d432-4dc5-b2c3-99f3601f9fa5 tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.471s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-c90fe3e3-db59-471b-b482-0ed33f83ee0d req-2d7e541d-d432-4dc5-b2c3-99f3601f9fa5 tempest-AttachVolumeNegativeTest-873513332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-67222a7b-2843-4adf-bc4d-15485daf00a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5eac671b-6c3a-43ca-9a89-2ff1b6fa5925', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:27:52 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.296s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:27:52 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Deleted volume successfully.
Aug 04 09:27:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2750ad23-85ef-4bd7-bf5c-768c947405c4 tempest-VolumesGetTest-1618516292 None] Lock "cinder-9d8a6e08-07cf-40dd-9b7f-03a58e47223b-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:52 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-c90fe3e3-db59-471b-b482-0ed33f83ee0d req-2d7e541d-d432-4dc5-b2c3-99f3601f9fa5 tempest-AttachVolumeNegativeTest-873513332 None] attachment_update completed successfully.
Aug 04 09:27:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "cinder-4f957017-299b-49bd-9dcc-7fa2d82cadeb-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-4f957017-299b-49bd-9dcc-7fa2d82cadeb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "cinder-quobyte-4f957017-299b-49bd-9dcc-7fa2d82cadeb" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-quobyte-4f957017-299b-49bd-9dcc-7fa2d82cadeb" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:53 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[da637b46-a95a-4c1f-872b-053e0e9f442d]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:53 devstack sudo[101464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb
Aug 04 09:27:53 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:53 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb" returned: 0 in 0.450s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:53 devstack sudo[101469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb
Aug 04 09:27:53 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:53 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4f957017-299b-49bd-9dcc-7fa2d82cadeb" returned: 0 in 0.306s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-quobyte-4f957017-299b-49bd-9dcc-7fa2d82cadeb" released by "delete_volume" :: held 0.808s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:53 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Created reservations ['cbf1fcd2-8ded-4172-8942-09acc6ea685e', '647ee6c1-63b8-4d1f-bb83-931f7a9f27e3', '393b24b3-027f-4606-87a3-00d1216032e0', '9fddfdcd-261d-43e1-bd2b-25c0fc797c9a'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:54 devstack sudo[101472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:27:54 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (bc5a1aee-32d7-4859-b72b-0396cc966a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab94434-4d43-4349-a5a1-3353e1ea44ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab94434-4d43-4349-a5a1-3353e1ea44ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-786739661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:54Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa46e19e-eaca-4947-968f-a1868a9e6e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa46e19e-eaca-4947-968f-a1868a9e6e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcb0db9-e312-4689-8f3e-69540003362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.image.glance [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Creating Keystone auth plugin from conf {{(pid=88880) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 04 09:27:54 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.345s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:27:54 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Deleted volume successfully.
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6db75f95-c627-423b-9cd9-99300669cbd1 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-4f957017-299b-49bd-9dcc-7fa2d82cadeb-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcb0db9-e312-4689-8f3e-69540003362f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c', 'volume_name': 'volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dafdd4260>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c580839c-f764-4025-9a8a-653d7976ef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c580839c-f764-4025-9a8a-653d7976ef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776e9437-5a6f-4249-b31b-09856e033f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:54 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Volume 565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dafdd4260>}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Trying to clone 565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c from image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]). {{(pid=88880) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Flow 'volume_create_manager' (e559678d-4861-4a2d-9ed2-9918f2681f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20cb8d5b-114f-4206-9e11-c6a08cabc776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20cb8d5b-114f-4206-9e11-c6a08cabc776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-928981129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d018219a-f4c7-44c2-a979-8b8e0fcd3ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734ed69a5974d86940fea1ef736eee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:55Z,use_quota=True,user_id='032b1559e06d4e5fa4cddb813106a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3195d6d-d880-4b30-8003-ccc294f0d768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3195d6d-d880-4b30-8003-ccc294f0d768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b3fe89-c132-455b-971f-b782796092ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b3fe89-c132-455b-971f-b782796092ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd018219a-f4c7-44c2-a979-8b8e0fcd3ae1', 'volume_name': 'volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb1abf9-d06e-426a-85e1-70894100c23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb1abf9-d06e-426a-85e1-70894100c23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853c24c1-1225-43ec-8145-02bead9fe89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:54 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Volume d018219a-f4c7-44c2-a979-8b8e0fcd3ae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1', 'volume_size': 1}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-928981129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d018219a-f4c7-44c2-a979-8b8e0fcd3ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734ed69a5974d86940fea1ef736eee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:55Z,use_quota=True,user_id='032b1559e06d4e5fa4cddb813106a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Creating volume d018219a-f4c7-44c2-a979-8b8e0fcd3ae1 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:27:54 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:27:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:55 devstack sudo[101475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1 1073741824
Aug 04 09:27:55 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:55 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 04 09:27:55 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Image download 20.69 MB at 20.69 MB/s
Aug 04 09:27:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b57e3f-19ce-40c8-9a93-43dd698ffefd]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:55 devstack sudo[101480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD
Aug 04 09:27:55 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:55 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1 1073741824" returned: 0 in 0.601s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:55 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=90,cinder:INSERT=32,cinder:UPDATE=125,cinder:DELETE=9 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:27:55 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=103,cinder:INSERT=23,cinder:UPDATE=120,cinder:DELETE=12 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:27:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:55 devstack sudo[101487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1
Aug 04 09:27:55 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:55 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD" returned: 0 in 0.428s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:55 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Temporary image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 is fetched for user 0d3c38ae17774c138a051f33f554a3c7. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 04 09:27:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed87e13-0bc7-4a33-8ff8-91c95c482d62]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:55 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-16c07fca-287b-4c57-9f75-35125c2df661 req-9cf8358c-1dbd-45fa-92b8-c56d3107288e tempest-AttachVolumeNegativeTest-873513332 None] Terminate volume connection completed successfully.
Aug 04 09:27:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-16c07fca-287b-4c57-9f75-35125c2df661 req-9cf8358c-1dbd-45fa-92b8-c56d3107288e tempest-AttachVolumeNegativeTest-873513332 None] Deleting attachment 5eac671b-6c3a-43ca-9a89-2ff1b6fa5925. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:27:56 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1" returned: 0 in 0.362s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853c24c1-1225-43ec-8145-02bead9fe89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32e1c74-27b9-4cd9-ac2e-47f9bcd73c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:56 devstack sudo[101519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD
Aug 04 09:27:56 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:56 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Volume volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1 (d018219a-f4c7-44c2-a979-8b8e0fcd3ae1): created successfully
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32e1c74-27b9-4cd9-ac2e-47f9bcd73c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Flow 'volume_create_manager' (e559678d-4861-4a2d-9ed2-9918f2681f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:56 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b7762729-152c-4877-97c2-a80f5d65fe88 tempest-VolumesActionsTest-1040140805 None] Created volume successfully.
Aug 04 09:27:56 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-786739661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:54Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Creating volume 565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:27:56 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:56 devstack sudo[101525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c 1073741824
Aug 04 09:27:56 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:56 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c 1073741824" returned: 0 in 0.500s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:56 devstack sudo[101532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c
Aug 04 09:27:56 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:57 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c" returned: 0 in 0.268s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "cinder-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Attempting download of 3846a4df-9a56-4b6a-83ff-12d6b09a1144 ((None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}])) to volume 565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87a0577-5c38-4285-91e8-4da3fd4af510]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_orkuz8bb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "cinder-quobyte-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-quobyte-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baaa437-f827-46b0-9c0d-fdad41e91010]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:57 devstack sudo[101552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_orkuz8bb
Aug 04 09:27:57 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:57 devstack sudo[101557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1
Aug 04 09:27:57 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:57 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_orkuz8bb" returned: 0 in 0.403s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_orkuz8bb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:57 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1" returned: 0 in 0.407s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:57 devstack sudo[101563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_orkuz8bb
Aug 04 09:27:57 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:57 devstack sudo[101568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1
Aug 04 09:27:57 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:58 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1" returned: 0 in 0.289s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:58 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_orkuz8bb" returned: 1 in 0.395s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_orkuz8bb' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e838c459-4270-4892-8a77-33df5517dc20]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-quobyte-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1" released by "delete_volume" :: held 0.778s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Created reservations ['4622ef1b-fa65-4567-abf1-50685e8b7db7', '2bb65494-838a-47ca-bc7b-7936ea119856', '17902195-80f9-498a-ac71-3028c29fa761', '58bd731c-6ced-430b-9947-8b0d52d28dd5'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:27:58 devstack sudo[101574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD
Aug 04 09:27:58 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:58 devstack sudo[101577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:27:58 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:58 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] 3846a4df-9a56-4b6a-83ff-12d6b09a1144 was qcow2, converting to raw {{(pid=88880) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:58 devstack sudo[101583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c
Aug 04 09:27:58 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:58 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.358s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:27:58 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Deleted volume successfully.
Aug 04 09:27:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8de49c78-5e02-42db-92f4-c95953af24e0 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-d018219a-f4c7-44c2-a979-8b8e0fcd3ae1-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Flow 'volume_create_manager' (8302c02d-d1f8-41c8-911e-8828e76c5b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1874f113-e6a5-45a3-bb2e-68f3d2153635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1874f113-e6a5-45a3-bb2e-68f3d2153635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-329288505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73429c4-a893-43c5-aabc-c2104a42b4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734ed69a5974d86940fea1ef736eee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:59Z,use_quota=True,user_id='032b1559e06d4e5fa4cddb813106a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ccc2b7-94bc-4c6c-a389-2e7b60d008ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ccc2b7-94bc-4c6c-a389-2e7b60d008ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97b80fa-0ba1-482b-bec8-1521ba8f8034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97b80fa-0ba1-482b-bec8-1521ba8f8034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f73429c4-a893-43c5-aabc-c2104a42b4ef', 'volume_name': 'volume-f73429c4-a893-43c5-aabc-c2104a42b4ef', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1727cfb-1ec4-4fd1-9277-4ea51176e51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1727cfb-1ec4-4fd1-9277-4ea51176e51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2948da9-e591-4c41-a703-8c8ab4adcdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:27:59 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Volume f73429c4-a893-43c5-aabc-c2104a42b4ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f73429c4-a893-43c5-aabc-c2104a42b4ef', 'volume_size': 1}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-329288505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73429c4-a893-43c5-aabc-c2104a42b4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734ed69a5974d86940fea1ef736eee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:27:59Z,use_quota=True,user_id='032b1559e06d4e5fa4cddb813106a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Creating volume f73429c4-a893-43c5-aabc-c2104a42b4ef {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:27:59 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f73429c4-a893-43c5-aabc-c2104a42b4ef 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:59 devstack sudo[101599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f73429c4-a893-43c5-aabc-c2104a42b4ef 1073741824
Aug 04 09:27:59 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:27:59 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f73429c4-a893-43c5-aabc-c2104a42b4ef 1073741824" returned: 0 in 0.548s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:27:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f73429c4-a893-43c5-aabc-c2104a42b4ef {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:27:59 devstack sudo[101606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f73429c4-a893-43c5-aabc-c2104a42b4ef
Aug 04 09:27:59 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:00 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f73429c4-a893-43c5-aabc-c2104a42b4ef" returned: 0 in 0.308s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2948da9-e591-4c41-a703-8c8ab4adcdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f73429c4-a893-43c5-aabc-c2104a42b4ef', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4c0868-e46c-46bd-9b20-bdc957437f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:00 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Volume volume-f73429c4-a893-43c5-aabc-c2104a42b4ef (f73429c4-a893-43c5-aabc-c2104a42b4ef): created successfully
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4c0868-e46c-46bd-9b20-bdc957437f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Flow 'volume_create_manager' (8302c02d-d1f8-41c8-911e-8828e76c5b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:00 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6c60fdf0-aed1-4b7c-8246-fd884463d490 tempest-VolumesActionsTest-1040140805 None] Created volume successfully.
Aug 04 09:28:00 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c" returned: 0 in 1.741s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_5v2orqg9devstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:28:00 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Converted 112.00 MB image at 64.31 MB/s
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:00 devstack sudo[101609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c 1G
Aug 04 09:28:00 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:00 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c 1G" returned: 0 in 0.287s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f440fd-eeef-4819-a405-4b85952a976b]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:00 devstack sudo[101614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c
Aug 04 09:28:00 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:00 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c" returned: 0 in 0.346s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:01 devstack sudo[101618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c
Aug 04 09:28:01 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "cinder-f73429c4-a893-43c5-aabc-c2104a42b4ef-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-f73429c4-a893-43c5-aabc-c2104a42b4ef-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:01 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c" returned: 1 in 0.451s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "cinder-quobyte-f73429c4-a893-43c5-aabc-c2104a42b4ef" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Downloaded image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 ((None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}])) to volume 565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c successfully. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Temporary image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 for user 0d3c38ae17774c138a051f33f554a3c7 is deleted. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Marking volume 565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c as bootable. {{(pid=88880) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "cinder-67222a7b-2843-4adf-bc4d-15485daf00a2-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-quobyte-f73429c4-a893-43c5-aabc-c2104a42b4ef" acquired by "delete_volume" :: waited 0.030s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Copying metadata from image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 to 565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c. {{(pid=88880) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Creating volume glance metadata for volume 565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c backed by image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88880) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f393d709-ad88-4c2c-b0de-c47ef1725956]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Lock "cinder-67222a7b-2843-4adf-bc4d-15485daf00a2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f73429c4-a893-43c5-aabc-c2104a42b4ef {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "cinder-quobyte-67222a7b-2843-4adf-bc4d-15485daf00a2" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Lock "cinder-quobyte-67222a7b-2843-4adf-bc4d-15485daf00a2" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddb677a-815f-43e3-a409-1094919317be]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:01 devstack sudo[101623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f73429c4-a893-43c5-aabc-c2104a42b4ef
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:01 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776e9437-5a6f-4249-b31b-09856e033f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dafdd4260>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447126ae-ef17-46ca-a91f-1f4208d38312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:01 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Volume volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c (565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c): created successfully
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447126ae-ef17-46ca-a91f-1f4208d38312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (bc5a1aee-32d7-4859-b72b-0396cc966a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:01 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-74e5f07c-9c94-46c9-b7ad-5abeb16f27f8 tempest-VolumesGetTest-1618516292 None] Created volume successfully.
Aug 04 09:28:01 devstack sudo[101625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2
Aug 04 09:28:01 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:01 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f73429c4-a893-43c5-aabc-c2104a42b4ef" returned: 0 in 0.404s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f73429c4-a893-43c5-aabc-c2104a42b4ef {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:01 devstack sudo[101630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f73429c4-a893-43c5-aabc-c2104a42b4ef
Aug 04 09:28:01 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:02 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2" returned: 0 in 0.393s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:02 devstack sudo[101635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2
Aug 04 09:28:02 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:02 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f73429c4-a893-43c5-aabc-c2104a42b4ef" returned: 0 in 0.268s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-quobyte-f73429c4-a893-43c5-aabc-c2104a42b4ef" released by "delete_volume" :: held 0.727s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Created reservations ['3a286200-8384-48d9-b6c5-394712dcae72', '99afd519-6981-4fec-a2f6-150b8577845f', '8115cf2f-bd06-4874-9bca-36b15f7d9fdb', '49ed7c09-ec43-481d-bec7-72a60e811058'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:02 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-67222a7b-2843-4adf-bc4d-15485daf00a2" returned: 0 in 0.267s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Lock "cinder-quobyte-67222a7b-2843-4adf-bc4d-15485daf00a2" released by "delete_volume" :: held 0.707s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:02 devstack sudo[101639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:02 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Created reservations ['f280a996-e5af-4e1b-b692-d489a6236cc6', '841a2686-74ec-4d13-b40f-fa148e0004a8', '5bd934d3-eb4c-4531-ad5e-1f5fae92c1fa', '0991a5b3-25d0-4f73-b0bc-ff080a5cbc09'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:02 devstack sudo[101641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:02 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (0a184937-3be9-45e0-8c7d-9f14c7779f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd753b7a-ce84-4c25-80a9-3ecf3b3b11bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd753b7a-ce84-4c25-80a9-3ecf3b3b11bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1949036317',display_name='tempest-VolumesGetTest-Volume-432671939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f345e2-ef8b-4d4a-8490-1d1f026152b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:03Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83e262ae-69f8-468a-a4d0-b23588672d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83e262ae-69f8-468a-a4d0-b23588672d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3251b7ae-10e7-4472-a953-30a0b3c3a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3251b7ae-10e7-4472-a953-30a0b3c3a333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f345e2-ef8b-4d4a-8490-1d1f026152b4', 'volume_name': 'volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65a70e8-eb83-4a5c-a442-3c012cd19854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65a70e8-eb83-4a5c-a442-3c012cd19854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42966d6c-4b40-4b99-b7f2-015c665a5185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:02 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Volume e9f345e2-ef8b-4d4a-8490-1d1f026152b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4', 'volume_size': 1}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1949036317',display_name='tempest-VolumesGetTest-Volume-432671939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f345e2-ef8b-4d4a-8490-1d1f026152b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b4c93d728442ee8c23fc4951dcd365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:03Z,use_quota=True,user_id='0d3c38ae17774c138a051f33f554a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Creating volume e9f345e2-ef8b-4d4a-8490-1d1f026152b4 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:02 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:28:02 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.406s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:02 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Deleted volume successfully.
Aug 04 09:28:02 devstack sudo[101645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4 1073741824
Aug 04 09:28:02 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "cinder-cb1e7505-d612-4917-bac2-b0a0bb1a8441-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Lock "cinder-cb1e7505-d612-4917-bac2-b0a0bb1a8441-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8ed2ecec-a372-4ecd-a8d4-70991e6ca0f2 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-f73429c4-a893-43c5-aabc-c2104a42b4ef-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:02 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.360s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:02 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Deleted volume successfully.
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "cinder-quobyte-cb1e7505-d612-4917-bac2-b0a0bb1a8441" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-03df9c2e-a734-4e32-bc11-924f58dffd7a tempest-AttachVolumeNegativeTest-873513332 None] Lock "cinder-67222a7b-2843-4adf-bc4d-15485daf00a2-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Lock "cinder-quobyte-cb1e7505-d612-4917-bac2-b0a0bb1a8441" acquired by "delete_volume" :: waited 0.033s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aa7c36-bc7e-4e25-8569-aab37c09878c]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:03 devstack sudo[101647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441
Aug 04 09:28:03 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Flow 'volume_create_manager' (e2db39bf-654d-4c63-92aa-955688062bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429a25bc-77ca-42c0-9911-a57a84146035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:03 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429a25bc-77ca-42c0-9911-a57a84146035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-312545620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdaa5cd7-947d-4403-acb1-bffbd22a754c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734ed69a5974d86940fea1ef736eee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:03Z,use_quota=True,user_id='032b1559e06d4e5fa4cddb813106a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b5c34c-254e-46ba-9499-4f8e818d495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b5c34c-254e-46ba-9499-4f8e818d495b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008f915b-9852-428a-a5cf-cfb5fbdf0b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008f915b-9852-428a-a5cf-cfb5fbdf0b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdaa5cd7-947d-4403-acb1-bffbd22a754c', 'volume_name': 'volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b349b2b4-fab5-4930-ae16-b8c862d84cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:03 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b349b2b4-fab5-4930-ae16-b8c862d84cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bcb37f6-85a1-4f60-8f0f-2f98f2dbd5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:03 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Volume cdaa5cd7-947d-4403-acb1-bffbd22a754c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c', 'volume_size': 1}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4 1073741824" returned: 0 in 0.605s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441" returned: 0 in 0.406s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:03 devstack sudo[101657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441
Aug 04 09:28:03 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:03 devstack sudo[101659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4
Aug 04 09:28:03 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:03 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cb1e7505-d612-4917-bac2-b0a0bb1a8441" returned: 0 in 0.258s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Lock "cinder-quobyte-cb1e7505-d612-4917-bac2-b0a0bb1a8441" released by "delete_volume" :: held 0.709s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:03 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4" returned: 0 in 0.257s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-312545620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdaa5cd7-947d-4403-acb1-bffbd22a754c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734ed69a5974d86940fea1ef736eee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:03Z,use_quota=True,user_id='032b1559e06d4e5fa4cddb813106a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Creating volume cdaa5cd7-947d-4403-acb1-bffbd22a754c {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:28:03 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:03 devstack sudo[101663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c 1073741824
Aug 04 09:28:03 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42966d6c-4b40-4b99-b7f2-015c665a5185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8963bef3-f0eb-4ce6-9dc9-5d831b6c14e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:03 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Volume volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4 (e9f345e2-ef8b-4d4a-8490-1d1f026152b4): created successfully
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8963bef3-f0eb-4ce6-9dc9-5d831b6c14e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Flow 'volume_create_manager' (0a184937-3be9-45e0-8c7d-9f14c7779f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Created reservations ['6608828c-b556-4fd1-a0e3-48e11f554476', 'e2273cf0-02cf-47ab-b784-825e6982e7d2', '3a9cf403-b05d-4159-827a-76fb235ff06c', '7ed6ac11-eab3-40b5-ad10-e7db3fa8c944'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:03 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-905bb888-9ee0-4003-9f98-bbfd5023c36a tempest-VolumesGetTest-1618516292 None] Created volume successfully.
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:03 devstack sudo[101665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:03 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:04 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.280s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:04 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Deleted volume successfully.
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-307336cc-1585-4399-914e-229ccce9720a tempest-AttachVolumeNegativeTest-873513332 None] Lock "cinder-cb1e7505-d612-4917-bac2-b0a0bb1a8441-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:04 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c 1073741824" returned: 0 in 0.543s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "cinder-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Lock "cinder-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:04 devstack sudo[101671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c
Aug 04 09:28:04 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "cinder-quobyte-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Lock "cinder-quobyte-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cffa1fc-4306-4e63-89a5-d4530e604485]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:04 devstack sudo[101673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e
Aug 04 09:28:04 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:04 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c" returned: 0 in 0.282s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bcb37f6-85a1-4f60-8f0f-2f98f2dbd5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439122f3-843c-447e-8a35-0adddea83962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:04 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Volume volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c (cdaa5cd7-947d-4403-acb1-bffbd22a754c): created successfully
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439122f3-843c-447e-8a35-0adddea83962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Flow 'volume_create_manager' (e2db39bf-654d-4c63-92aa-955688062bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:04 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-845cabed-9f6a-4c14-8ff1-995ec954109f tempest-VolumesActionsTest-1040140805 None] Created volume successfully.
Aug 04 09:28:04 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e" returned: 0 in 0.409s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:04 devstack sudo[101679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e
Aug 04 09:28:04 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-e9f345e2-ef8b-4d4a-8490-1d1f026152b4-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Lock "cinder-e9f345e2-ef8b-4d4a-8490-1d1f026152b4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-quobyte-e9f345e2-ef8b-4d4a-8490-1d1f026152b4" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-e9f345e2-ef8b-4d4a-8490-1d1f026152b4" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0110b9e3-544f-411b-92eb-8c9f21f3f8c6]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:05 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e" returned: 0 in 0.268s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Lock "cinder-quobyte-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e" released by "delete_volume" :: held 0.717s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:05 devstack sudo[101681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4
Aug 04 09:28:05 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Created reservations ['b5657a11-aeb6-410c-abae-1f666e834001', '81f93f8d-0f8c-414b-9fca-3f24d2ec1338', 'b646e0b3-5b37-4f58-8d98-1311adda0a77', '513742b6-0c5e-4d22-bbeb-0182bd87263e'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:05 devstack sudo[101684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:05 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:05 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4" returned: 0 in 0.439s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:05 devstack sudo[101689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4
Aug 04 09:28:05 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:05 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.279s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:05 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Deleted volume successfully.
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1085c5ca-78f1-40d0-ac23-55d999d3878d tempest-AttachVolumeNegativeTest-873513332 None] Lock "cinder-7f2e7648-2096-4ee0-9fca-9cdb9ee8b01e-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "cinder-cdaa5cd7-947d-4403-acb1-bffbd22a754c-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-cdaa5cd7-947d-4403-acb1-bffbd22a754c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "cinder-quobyte-cdaa5cd7-947d-4403-acb1-bffbd22a754c" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-quobyte-cdaa5cd7-947d-4403-acb1-bffbd22a754c" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f621f718-e9bf-458d-8f71-4ef18bb19117]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:05 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9f345e2-ef8b-4d4a-8490-1d1f026152b4" returned: 0 in 0.326s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-e9f345e2-ef8b-4d4a-8490-1d1f026152b4" released by "delete_volume" :: held 0.824s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Created reservations ['00f0dec3-cdbd-4914-be79-bac19b363142', '2485c89f-8a9e-4574-b298-18678ad7dbbb', 'd37360be-09e0-40e4-b7cf-38095ac39c3f', '6a29d1f9-7577-411d-90e3-751d3db0f8a0'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:05 devstack sudo[101693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c
Aug 04 09:28:05 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:05 devstack sudo[101695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:05 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:06 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c" returned: 0 in 0.438s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Lock "cinder-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:06 devstack sudo[101701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c
Aug 04 09:28:06 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:06 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.332s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:06 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Deleted volume successfully.
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Acquiring lock "cinder-quobyte-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-194b8eaa-7333-42cb-8ac5-374decf97164 tempest-VolumesGetTest-1618516292 None] Lock "cinder-e9f345e2-ef8b-4d4a-8490-1d1f026152b4-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c" acquired by "delete_volume" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b908fffe-430f-420d-b498-5aa92d36de22]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:06 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cdaa5cd7-947d-4403-acb1-bffbd22a754c" returned: 0 in 0.325s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:06 devstack sudo[101703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c
Aug 04 09:28:06 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-quobyte-cdaa5cd7-947d-4403-acb1-bffbd22a754c" released by "delete_volume" :: held 0.811s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Created reservations ['a4d1df41-3891-4b02-8605-67a47d9a3e5a', '795994bf-f7b9-4c63-93a2-c572715d003c', '5fe4b040-eda9-4c66-9e31-0eec417f5941', 'fbee63a3-4a9e-409b-92b0-5d1530beb8f6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:06 devstack sudo[101706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:06 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:06 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c" returned: 0 in 0.432s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:06 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.284s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:06 devstack sudo[101710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c
Aug 04 09:28:06 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:06 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Deleted volume successfully.
Aug 04 09:28:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-520689d5-27d3-4dbe-a09b-af52ef7359c0 tempest-VolumesActionsTest-2097163006 None] Lock "cinder-cdaa5cd7-947d-4403-acb1-bffbd22a754c-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:07 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c" returned: 1 in 0.452s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:07 devstack sudo[101717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c
Aug 04 09:28:07 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Flow 'volume_create_manager' (80aed7ff-7149-41d6-92e1-67277a9dcb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7f528d-d88a-4231-84ff-93c7f2866b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7f528d-d88a-4231-84ff-93c7f2866b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1422723264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ceec6d5-146a-4ca1-97bc-3e4e35f65265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734ed69a5974d86940fea1ef736eee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:07Z,use_quota=True,user_id='032b1559e06d4e5fa4cddb813106a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:07 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4e02e4-6b65-41db-b3c7-8a8c33159e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4e02e4-6b65-41db-b3c7-8a8c33159e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c89dbce-6dca-4430-b85e-081c486c5008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c89dbce-6dca-4430-b85e-081c486c5008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ceec6d5-146a-4ca1-97bc-3e4e35f65265', 'volume_name': 'volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afff8bb9-2059-4267-bbaa-5ba96bec14e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afff8bb9-2059-4267-bbaa-5ba96bec14e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b0f657-d34a-480c-962f-4507cc71f6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:07 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Volume 1ceec6d5-146a-4ca1-97bc-3e4e35f65265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265', 'volume_size': 1}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1422723264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ceec6d5-146a-4ca1-97bc-3e4e35f65265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734ed69a5974d86940fea1ef736eee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:07Z,use_quota=True,user_id='032b1559e06d4e5fa4cddb813106a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Creating volume 1ceec6d5-146a-4ca1-97bc-3e4e35f65265 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:28:07 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c" returned: 0 in 0.358s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:07 devstack sudo[101720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265 1073741824
Aug 04 09:28:07 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Lock "cinder-quobyte-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c" released by "delete_volume" :: held 1.310s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Created reservations ['0d47dc4d-4e36-4d64-8070-34e2db9f6255', '306e9e84-3542-489e-bb81-fe726b1f2396', '9dbe6962-2492-4f06-90f2-63db22332d22', '085f3013-8181-4411-863f-29bea49d1033'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:07 devstack sudo[101722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:07 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:07 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.262s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:08 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:08 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Deleted volume successfully.
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265 1073741824" returned: 0 in 0.455s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3bbe1478-af35-416e-9087-5897ce80e2f7 tempest-VolumesGetTest-1618516292 None] Lock "cinder-565ab9a0-cbf0-43e1-980a-8b8c50dd9b3c-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:08 devstack sudo[101729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265
Aug 04 09:28:08 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:08 devstack sudo[101731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:08 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:08 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265" returned: 0 in 0.268s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b0f657-d34a-480c-962f-4507cc71f6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb820de9-cf50-469b-80b7-2b03bbe5131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:08 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Volume volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265 (1ceec6d5-146a-4ca1-97bc-3e4e35f65265): created successfully
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb820de9-cf50-469b-80b7-2b03bbe5131b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Flow 'volume_create_manager' (80aed7ff-7149-41d6-92e1-67277a9dcb14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:08 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-0fa0f735-67e2-4e43-844f-0ef32efd2535 tempest-VolumesActionsTest-1040140805 None] Created volume successfully.
Aug 04 09:28:08 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.317s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:28:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:28:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Acquiring lock "cinder-1ceec6d5-146a-4ca1-97bc-3e4e35f65265-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Lock "cinder-1ceec6d5-146a-4ca1-97bc-3e4e35f65265-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Acquiring lock "cinder-quobyte-1ceec6d5-146a-4ca1-97bc-3e4e35f65265" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Lock "cinder-quobyte-1ceec6d5-146a-4ca1-97bc-3e4e35f65265" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:10 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef39fed0-5a37-44b8-9942-b9e15d1e41b6]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:10 devstack sudo[101738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265
Aug 04 09:28:10 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:10 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265" returned: 0 in 0.393s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:10 devstack sudo[101743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265
Aug 04 09:28:10 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:11 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ceec6d5-146a-4ca1-97bc-3e4e35f65265" returned: 0 in 0.269s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Lock "cinder-quobyte-1ceec6d5-146a-4ca1-97bc-3e4e35f65265" released by "delete_volume" :: held 0.713s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Created reservations ['038973d3-b61f-43ff-934a-a7e4cc2e5e12', 'dd90daa1-a5f5-4765-90f2-af5d9946ab94', '223970d1-199d-4d89-b903-bc6759c1fd45', 'f496b7ed-779c-403e-9f57-85ef8372a885'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:11 devstack sudo[101746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:11 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:11 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.275s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Deleted volume successfully.
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1b1bcf3d-0ffd-489d-919e-8172368427fb tempest-VolumesActionsTest-1040140805 None] Lock "cinder-1ceec6d5-146a-4ca1-97bc-3e4e35f65265-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Flow 'volume_create_manager' (7a9b93c0-6b69-4e0a-b0f3-f7709c5bb028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35131ccc-ada1-44e1-b2f5-79676960271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35131ccc-ada1-44e1-b2f5-79676960271f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-178645312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a5d6aa-0cf9-4916-a3ee-052e785888ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36076dc3d4ac409b94130e82d6d1df3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:12Z,use_quota=True,user_id='c370b994e0724d07b69bd63f3a1533ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcba61aa-d011-497c-be61-5d4087f15fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcba61aa-d011-497c-be61-5d4087f15fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95fd34d-f1e9-48da-8737-63a2290c1c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95fd34d-f1e9-48da-8737-63a2290c1c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28a5d6aa-0cf9-4916-a3ee-052e785888ee', 'volume_name': 'volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a01735-4afa-4236-a74a-e112d7b99c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a01735-4afa-4236-a74a-e112d7b99c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37aad380-b58d-441c-9666-2184b7c84d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:11 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Volume 28a5d6aa-0cf9-4916-a3ee-052e785888ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee', 'volume_size': 1}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-178645312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a5d6aa-0cf9-4916-a3ee-052e785888ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36076dc3d4ac409b94130e82d6d1df3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:12Z,use_quota=True,user_id='c370b994e0724d07b69bd63f3a1533ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Creating volume 28a5d6aa-0cf9-4916-a3ee-052e785888ee {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:28:11 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:28:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:12 devstack sudo[101749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee 1073741824
Aug 04 09:28:12 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:12 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee 1073741824" returned: 0 in 0.527s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:12 devstack sudo[101755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee
Aug 04 09:28:12 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:12 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee" returned: 0 in 0.261s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:28:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37aad380-b58d-441c-9666-2184b7c84d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31aaf64c-e6bc-4cf6-9a6c-a4468921f7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:12 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Volume volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee (28a5d6aa-0cf9-4916-a3ee-052e785888ee): created successfully
Aug 04 09:28:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31aaf64c-e6bc-4cf6-9a6c-a4468921f7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Flow 'volume_create_manager' (7a9b93c0-6b69-4e0a-b0f3-f7709c5bb028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:12 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f824961f-abc4-4d5a-8173-7691b858dbef tempest-VolumesListTestJSON-1438433223 None] Created volume successfully.
Aug 04 09:28:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9e81bbde-a44d-456c-89be-52b1dc8e9f33 tempest-GroupSnapshotsTest-1723145840 None] Group tempest-GroupSnapshotsTest-Group-1635275202: creating
Aug 04 09:28:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9e81bbde-a44d-456c-89be-52b1dc8e9f33 tempest-GroupSnapshotsTest-1723145840 None] Group tempest-GroupSnapshotsTest-Group-1635275202: created successfully
Aug 04 09:28:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9e81bbde-a44d-456c-89be-52b1dc8e9f33 tempest-GroupSnapshotsTest-1723145840 None] Create group completed successfully.
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Flow 'volume_create_manager' (8c761f6d-2741-4ba1-9778-cac02d97d9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612e5794-58fb-419f-8b8b-ff7b8824f6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612e5794-58fb-419f-8b8b-ff7b8824f6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1755103089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c2d848-4202-4534-a8f2-83f6fa0f924d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36076dc3d4ac409b94130e82d6d1df3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:14Z,use_quota=True,user_id='c370b994e0724d07b69bd63f3a1533ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7379144-4aec-4393-aa2b-090d49d87b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7379144-4aec-4393-aa2b-090d49d87b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf0a711-c268-41e5-82d5-b056ce5b892e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf0a711-c268-41e5-82d5-b056ce5b892e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c2d848-4202-4534-a8f2-83f6fa0f924d', 'volume_name': 'volume-13c2d848-4202-4534-a8f2-83f6fa0f924d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f5d386-ee2b-4bcd-9491-621c1ddde989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f5d386-ee2b-4bcd-9491-621c1ddde989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c242e9-2c7c-470e-95b7-7d631b30656e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:14 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Volume 13c2d848-4202-4534-a8f2-83f6fa0f924d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c2d848-4202-4534-a8f2-83f6fa0f924d', 'volume_size': 1}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1755103089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c2d848-4202-4534-a8f2-83f6fa0f924d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36076dc3d4ac409b94130e82d6d1df3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:14Z,use_quota=True,user_id='c370b994e0724d07b69bd63f3a1533ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Creating volume 13c2d848-4202-4534-a8f2-83f6fa0f924d {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:28:14 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:28:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13c2d848-4202-4534-a8f2-83f6fa0f924d 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:14 devstack sudo[101759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13c2d848-4202-4534-a8f2-83f6fa0f924d 1073741824
Aug 04 09:28:14 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Flow 'volume_create_manager' (9a86eec5-51f2-41fe-929b-505d42ea9d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076b3b86-0bc8-4bf3-b9b6-27913d506273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076b3b86-0bc8-4bf3-b9b6-27913d506273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-580841210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5b98ebec-df2d-4fc3-9e3b-e9a16c11675b,host='devstack@QuobyteHD#QuobyteHD',id=13759691-4e7f-4490-9f25-b4a19da31956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0773194052493880145aecd29623c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:15Z,use_quota=True,user_id='8649aef2b920484fbc9fe462ae3fb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(beca0c24-c85a-474a-97ba-14d46db23c68),volume_type_id=beca0c24-c85a-474a-97ba-14d46db23c68)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5be364-bd5e-4132-b03d-5e4600cb3358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5be364-bd5e-4132-b03d-5e4600cb3358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbe20fb-c8a7-472a-8a23-9b93b4149426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbe20fb-c8a7-472a-8a23-9b93b4149426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13759691-4e7f-4490-9f25-b4a19da31956', 'volume_name': 'volume-13759691-4e7f-4490-9f25-b4a19da31956', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:15 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e57352f-98ff-4036-8d26-11a811c12593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e57352f-98ff-4036-8d26-11a811c12593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e46df93-2802-4b57-99a9-20caae240233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:15 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Volume 13759691-4e7f-4490-9f25-b4a19da31956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13759691-4e7f-4490-9f25-b4a19da31956', 'volume_size': 1}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13c2d848-4202-4534-a8f2-83f6fa0f924d 1073741824" returned: 0 in 0.603s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13c2d848-4202-4534-a8f2-83f6fa0f924d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:15 devstack sudo[101765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13c2d848-4202-4534-a8f2-83f6fa0f924d
Aug 04 09:28:15 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:15 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13c2d848-4202-4534-a8f2-83f6fa0f924d" returned: 0 in 0.251s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.289s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5b98ebec-df2d-4fc3-9e3b-e9a16c11675b,created_at=2026-08-04T07:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-580841210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5b98ebec-df2d-4fc3-9e3b-e9a16c11675b,host='devstack@QuobyteHD#QuobyteHD',id=13759691-4e7f-4490-9f25-b4a19da31956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0773194052493880145aecd29623c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:15Z,use_quota=True,user_id='8649aef2b920484fbc9fe462ae3fb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(beca0c24-c85a-474a-97ba-14d46db23c68),volume_type_id=beca0c24-c85a-474a-97ba-14d46db23c68)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Creating volume 13759691-4e7f-4490-9f25-b4a19da31956 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:28:15 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c242e9-2c7c-470e-95b7-7d631b30656e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c2d848-4202-4534-a8f2-83f6fa0f924d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:15 devstack sudo[101768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 1073741824
Aug 04 09:28:15 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac4bdd2-f866-4896-be1a-1a5f2d7feae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:15 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Volume volume-13c2d848-4202-4534-a8f2-83f6fa0f924d (13c2d848-4202-4534-a8f2-83f6fa0f924d): created successfully
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac4bdd2-f866-4896-be1a-1a5f2d7feae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Flow 'volume_create_manager' (8c761f6d-2741-4ba1-9778-cac02d97d9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:15 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-397141f0-f107-4fb8-a4c5-55a9ac711045 tempest-VolumesListTestJSON-1438433223 None] Created volume successfully.
Aug 04 09:28:15 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 1073741824" returned: 0 in 0.433s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:15 devstack sudo[101774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956
Aug 04 09:28:15 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:16 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956" returned: 0 in 0.277s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:28:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e46df93-2802-4b57-99a9-20caae240233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13759691-4e7f-4490-9f25-b4a19da31956', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa5a518-a3e4-463a-8d8f-6c8592d8dffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:16 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Volume volume-13759691-4e7f-4490-9f25-b4a19da31956 (13759691-4e7f-4490-9f25-b4a19da31956): created successfully
Aug 04 09:28:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa5a518-a3e4-463a-8d8f-6c8592d8dffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Flow 'volume_create_manager' (9a86eec5-51f2-41fe-929b-505d42ea9d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:16 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-35ac8097-d436-49ee-9e45-4cd3e9874503 tempest-GroupSnapshotsTest-1723145840 None] Created volume successfully.
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Flow 'volume_create_manager' (d0ca6a1e-ca1b-448b-8b67-2f954827a2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab10566-d17f-4e42-b27c-214126eab3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab10566-d17f-4e42-b27c-214126eab3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1092038267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbb0b54-6ae4-4bab-99c7-16a59b65969a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36076dc3d4ac409b94130e82d6d1df3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:17Z,use_quota=True,user_id='c370b994e0724d07b69bd63f3a1533ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f05c115-edf0-446d-b81a-a5319b701ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f05c115-edf0-446d-b81a-a5319b701ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ac4304-e274-4839-93d9-46815089284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ac4304-e274-4839-93d9-46815089284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fbb0b54-6ae4-4bab-99c7-16a59b65969a', 'volume_name': 'volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c636c19-8cc5-4bee-b264-645fb38f12ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c636c19-8cc5-4bee-b264-645fb38f12ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fc45a1-6714-4248-9cbf-40602721e623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:17 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Volume 7fbb0b54-6ae4-4bab-99c7-16a59b65969a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a', 'volume_size': 1}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1092038267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbb0b54-6ae4-4bab-99c7-16a59b65969a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36076dc3d4ac409b94130e82d6d1df3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:17Z,use_quota=True,user_id='c370b994e0724d07b69bd63f3a1533ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Creating volume 7fbb0b54-6ae4-4bab-99c7-16a59b65969a {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:28:17 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:17 devstack sudo[101778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a 1073741824
Aug 04 09:28:17 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:17 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a 1073741824" returned: 0 in 0.496s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:17 devstack sudo[101784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a
Aug 04 09:28:17 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:17 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] GroupSnapshot befad733-a4c3-4034-a33d-8cb8402830cf: creating.
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] Group snapshot befad733-a4c3-4034-a33d-8cb8402830cf: creating. {{(pid=88880) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:17 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a" returned: 0 in 0.269s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.126s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] Creating offline snapshot f4a06003-0851-4a18-8181-e4cff58aa722 of volume 13759691-4e7f-4490-9f25-b4a19da31956 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:28:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fc45a1-6714-4248-9cbf-40602721e623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab410129-91ad-4dcf-ab99-1f6956884b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:18 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[107cad85-18ac-4970-91b7-46ab83ca08ad]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:18 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Volume volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a (7fbb0b54-6ae4-4bab-99c7-16a59b65969a): created successfully
Aug 04 09:28:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab410129-91ad-4dcf-ab99-1f6956884b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Flow 'volume_create_manager' (d0ca6a1e-ca1b-448b-8b67-2f954827a2de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:18 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b6c689c0-eb70-4238-abfe-e58e059da591 tempest-VolumesListTestJSON-1438433223 None] Created volume successfully.
Aug 04 09:28:18 devstack sudo[101787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956
Aug 04 09:28:18 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:18 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956" returned: 0 in 0.431s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:18 devstack sudo[101792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722 1G
Aug 04 09:28:18 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:18 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722 1G" returned: 0 in 0.431s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13759691-4e7f-4490-9f25-b4a19da31956 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:18 devstack sudo[101797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13759691-4e7f-4490-9f25-b4a19da31956 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722
Aug 04 09:28:18 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:19 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13759691-4e7f-4490-9f25-b4a19da31956 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722" returned: 0 in 0.388s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:19 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722 is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:28:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:19 devstack sudo[101804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722
Aug 04 09:28:19 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:19 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722" returned: 0 in 0.299s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:19 devstack sudo[101808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.info
Aug 04 09:28:19 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:19 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.info" returned: 0 in 0.272s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:19 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:28:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:19 devstack sudo[101811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.info
Aug 04 09:28:19 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:20 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.info" returned: 0 in 0.266s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:20 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-87b7ad69-eacf-489d-b7f3-78d543e0a9b1 tempest-GroupSnapshotsTest-1723145840 None] group_snapshot befad733-a4c3-4034-a33d-8cb8402830cf: created successfully
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "cinder-7fbb0b54-6ae4-4bab-99c7-16a59b65969a-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Lock "cinder-7fbb0b54-6ae4-4bab-99c7-16a59b65969a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "cinder-quobyte-7fbb0b54-6ae4-4bab-99c7-16a59b65969a" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Lock "cinder-quobyte-7fbb0b54-6ae4-4bab-99c7-16a59b65969a" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7464c68-dd1a-4275-9037-e7d8598e9c5f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:21 devstack sudo[101814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a
Aug 04 09:28:21 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-f4a06003-0851-4a18-8181-e4cff58aa722-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" by "_create_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-f4a06003-0851-4a18-8181-e4cff58aa722-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Creating volume 84b1fe74-0deb-4d0b-afa5-32bce10a1ad0 from snapshot f4a06003-0851-4a18-8181-e4cff58aa722 {{(pid=88880) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" by "_copy_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] snapshot: f4a06003-0851-4a18-8181-e4cff58aa722, volume: 84b1fe74-0deb-4d0b-afa5-32bce10a1ad0,  {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[098962ab-8d2f-4fa9-a432-bbe59f0f32e1]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:22 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a" returned: 0 in 0.395s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:22 devstack sudo[101820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a
Aug 04 09:28:22 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:22 devstack sudo[101816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722
Aug 04 09:28:22 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:22 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbb0b54-6ae4-4bab-99c7-16a59b65969a" returned: 0 in 0.309s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Lock "cinder-quobyte-7fbb0b54-6ae4-4bab-99c7-16a59b65969a" released by "delete_volume" :: held 0.750s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:22 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722" returned: 0 in 0.428s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13759691-4e7f-4490-9f25-b4a19da31956(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Creating direct copy from snapshot {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b1d2b1-56fa-42dc-9aa3-951d5e9dcfc3]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Created reservations ['5672289c-37b0-41b5-b9fa-d305b9a0bb59', '3b68ca91-dd6d-4eca-91bf-ee28ed5a4a76', 'f59ac1fd-c7af-4298-8cd7-3a87af0d790e', '2767e78b-8623-4ba1-b10f-69ad8f4fc770'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:22 devstack sudo[101828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:22 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:22 devstack sudo[101830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:22 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "cinder-13c2d848-4202-4534-a8f2-83f6fa0f924d-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:22 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956" returned: 0 in 0.419s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:22 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.utils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Path /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0 not found in is_blk_device check {{(pid=88880) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.326s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Lock "cinder-13c2d848-4202-4534-a8f2-83f6fa0f924d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:22 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Deleted volume successfully.
Aug 04 09:28:22 devstack sudo[101836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0
Aug 04 09:28:22 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6dc0de42-719d-4849-ab74-e8969e725431 tempest-VolumesListTestJSON-1438433223 None] Lock "cinder-7fbb0b54-6ae4-4bab-99c7-16a59b65969a-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "cinder-quobyte-13c2d848-4202-4534-a8f2-83f6fa0f924d" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Lock "cinder-quobyte-13c2d848-4202-4534-a8f2-83f6fa0f924d" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a6cd87-0add-4a5b-b0f2-4ca5e1d019a8]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13c2d848-4202-4534-a8f2-83f6fa0f924d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:23 devstack sudo[101838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13c2d848-4202-4534-a8f2-83f6fa0f924d
Aug 04 09:28:23 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:23 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13c2d848-4202-4534-a8f2-83f6fa0f924d" returned: 0 in 0.469s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13c2d848-4202-4534-a8f2-83f6fa0f924d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:23 devstack sudo[101853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13c2d848-4202-4534-a8f2-83f6fa0f924d
Aug 04 09:28:23 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:24 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13c2d848-4202-4534-a8f2-83f6fa0f924d" returned: 0 in 0.643s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Lock "cinder-quobyte-13c2d848-4202-4534-a8f2-83f6fa0f924d" released by "delete_volume" :: held 1.182s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:24 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Created reservations ['b11086d3-bb21-4fdc-b502-b37c1ef70366', 'dca0c8fc-5c78-412b-bb8e-abbcda87541c', '164f8028-1d6b-4109-937e-464d150d7afa', '41dfa909-7efe-4b4b-9ac5-c1fcfee0398d'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:24 devstack sudo[101856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:24 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:24 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.527s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:24 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:24 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Deleted volume successfully.
Aug 04 09:28:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9c01e40f-611f-4193-a203-4c29ea73a94b tempest-VolumesListTestJSON-1438433223 None] Lock "cinder-13c2d848-4202-4534-a8f2-83f6fa0f924d-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "cinder-28a5d6aa-0cf9-4916-a3ee-052e785888ee-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Lock "cinder-28a5d6aa-0cf9-4916-a3ee-052e785888ee-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "cinder-quobyte-28a5d6aa-0cf9-4916-a3ee-052e785888ee" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Lock "cinder-quobyte-28a5d6aa-0cf9-4916-a3ee-052e785888ee" acquired by "delete_volume" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:25 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6950793c-5441-4b0a-b573-c3bb1ede0678]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:26 devstack sudo[101861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee
Aug 04 09:28:26 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:26 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee" returned: 0 in 0.710s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:26 devstack sudo[101867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee
Aug 04 09:28:26 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:27 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-28a5d6aa-0cf9-4916-a3ee-052e785888ee" returned: 0 in 0.573s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Lock "cinder-quobyte-28a5d6aa-0cf9-4916-a3ee-052e785888ee" released by "delete_volume" :: held 1.401s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:27 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Created reservations ['5a9c4499-efa3-433f-843b-bb39d39de3e3', '3f542219-66e5-49e1-8a21-25ebe91de1c0', '99695a64-4799-4fcd-b222-244b98b15870', '3f6bdab3-a080-49de-bb41-dd6fb9468179'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:27 devstack sudo[101870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:27 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:27 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Flow 'volume_create_manager' (e411e128-851a-40d2-82e2-46568c9dcd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ed51d2-1f21-4fe7-a918-3caae9be2f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ed51d2-1f21-4fe7-a918-3caae9be2f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-623045176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a02eff-fff5-427d-9df6-979a1ff58750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f32f8182bb49819b916049de2cbace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:28Z,use_quota=True,user_id='edff9a95ace54252b52ff4554d58e1c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b43e23-f84a-4661-8b45-71088250ff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b43e23-f84a-4661-8b45-71088250ff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1376c6-ecb4-4a50-8228-ef02d49ab2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1376c6-ecb4-4a50-8228-ef02d49ab2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a02eff-fff5-427d-9df6-979a1ff58750', 'volume_name': 'volume-52a02eff-fff5-427d-9df6-979a1ff58750', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5738be-702e-4fc5-b894-f6671c3c8205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5738be-702e-4fc5-b894-f6671c3c8205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1269ac64-b7cf-4cee-8257-0d221d619efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:28 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Volume 52a02eff-fff5-427d-9df6-979a1ff58750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a02eff-fff5-427d-9df6-979a1ff58750', 'volume_size': 1}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:28 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.706s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:28 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:28 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Deleted volume successfully.
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" returned: 0 in 5.559s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4b480f-d3fe-439b-a21e-d26227dd00bf]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a1b309e0-0f1c-453a-a7ed-e0295241050c tempest-VolumesListTestJSON-1438433223 None] Lock "cinder-28a5d6aa-0cf9-4916-a3ee-052e785888ee-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:28 devstack sudo[101875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956
Aug 04 09:28:28 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:28 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956" returned: 0 in 0.575s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:28:28 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Converted 1024.00 MB image at 184.19 MB/s
Aug 04 09:28:28 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0 is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:28:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:29 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0
Aug 04 09:28:29 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:29 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" returned: 0 in 0.262s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" released by "_copy_volume_from_snapshot" :: held 7.362s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-f4a06003-0851-4a18-8181-e4cff58aa722-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" released by "_create_volume_from_snapshot" :: held 7.398s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.419s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-623045176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a02eff-fff5-427d-9df6-979a1ff58750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f32f8182bb49819b916049de2cbace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:28Z,use_quota=True,user_id='edff9a95ace54252b52ff4554d58e1c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Creating volume 52a02eff-fff5-427d-9df6-979a1ff58750 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:28:29 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:29 devstack sudo[101883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 1073741824
Aug 04 09:28:29 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:29 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-00901585-c3e5-4a2f-bdb4-25c97bbce5fd tempest-GroupSnapshotsTest-1723145840 None] Create group from source-snapshot-befad733-a4c3-4034-a33d-8cb8402830cf completed successfully.
Aug 04 09:28:29 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 1073741824" returned: 0 in 0.457s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:29 devstack sudo[101890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750
Aug 04 09:28:29 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:30 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750" returned: 0 in 0.245s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:28:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1269ac64-b7cf-4cee-8257-0d221d619efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a02eff-fff5-427d-9df6-979a1ff58750', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790ac2ab-5ac5-403b-a48d-241de43b13cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Volume volume-52a02eff-fff5-427d-9df6-979a1ff58750 (52a02eff-fff5-427d-9df6-979a1ff58750): created successfully
Aug 04 09:28:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790ac2ab-5ac5-403b-a48d-241de43b13cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Flow 'volume_create_manager' (e411e128-851a-40d2-82e2-46568c9dcd1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:30 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-703fe061-f3c9-4f80-bfe8-96b5f91d9c03 tempest-VolumesCloneTest-1339312013 None] Created volume successfully.
Aug 04 09:28:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:30 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2736638-9916-4d60-9e08-85b517009878]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:30 devstack sudo[101893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0
Aug 04 09:28:30 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:31 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" returned: 0 in 0.387s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:31 devstack sudo[101898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0
Aug 04 09:28:31 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Flow 'volume_create_manager' (a1de11ed-63d3-4891-8646-4f97f17e3283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd150aad-b189-4491-ae52-809fa8ef57e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd150aad-b189-4491-ae52-809fa8ef57e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1846510595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9a46b9-26b5-419e-813a-5b13005889fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d4752d10cb4957ad6e88484c6406b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:31Z,use_quota=True,user_id='aaa0daba0a2d4f999e537d2506e4a4f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5a8b29-6818-43bf-a185-f6adfa19db83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5a8b29-6818-43bf-a185-f6adfa19db83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f546b784-42ce-4656-a312-d741725c5d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f546b784-42ce-4656-a312-d741725c5d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9a46b9-26b5-419e-813a-5b13005889fb', 'volume_name': 'volume-9d9a46b9-26b5-419e-813a-5b13005889fb', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e77d1e-51c9-42a5-a08f-432cf11b9542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e77d1e-51c9-42a5-a08f-432cf11b9542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d55cc43-db59-406f-9345-4b38d5455dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:31 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Volume 9d9a46b9-26b5-419e-813a-5b13005889fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9a46b9-26b5-419e-813a-5b13005889fb', 'volume_size': 1}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1846510595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9a46b9-26b5-419e-813a-5b13005889fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d4752d10cb4957ad6e88484c6406b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:31Z,use_quota=True,user_id='aaa0daba0a2d4f999e537d2506e4a4f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Creating volume 9d9a46b9-26b5-419e-813a-5b13005889fb {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:28:31 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d9a46b9-26b5-419e-813a-5b13005889fb 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:31 devstack sudo[101900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d9a46b9-26b5-419e-813a-5b13005889fb 1073741824
Aug 04 09:28:31 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:31 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" returned: 0 in 0.276s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-84b1fe74-0deb-4d0b-afa5-32bce10a1ad0" released by "delete_volume" :: held 0.711s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['c0d86e6b-a5bd-43ad-8033-30aaad6d86e3'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:31 devstack cinder-volume[88880]: WARNING cinder.quota [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1132120374 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1132120374, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:28:31 devstack cinder-volume[88880]: WARNING cinder.quota [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1132120374 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1132120374, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['3dfcca41-5ebb-4705-8948-8d88a851f673', '6c19c2f2-a89f-4674-840a-54ea1faff227', 'fbaab62f-c095-4c0b-8543-b7128064d911', '3cb85d20-caae-4e90-af7e-99cf4ae3ea65'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:31 devstack sudo[101907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:31 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Flow 'volume_create_manager' (4179f36d-a504-4e59-8143-9ec2485f2b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bcbb02-3ceb-4b9a-a6af-d18c0a65fffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bcbb02-3ceb-4b9a-a6af-d18c0a65fffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-954455082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49eb634-7340-48e7-bc18-0bb51de50094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f32f8182bb49819b916049de2cbace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=52a02eff-fff5-427d-9df6-979a1ff58750,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:32Z,use_quota=True,user_id='edff9a95ace54252b52ff4554d58e1c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef089e3-f171-413e-954f-d4053439ffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef089e3-f171-413e-954f-d4053439ffc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697081ce-c190-4450-90b1-6c6f91ef88ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:31 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d9a46b9-26b5-419e-813a-5b13005889fb 1073741824" returned: 0 in 0.540s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697081ce-c190-4450-90b1-6c6f91ef88ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd49eb634-7340-48e7-bc18-0bb51de50094', 'volume_name': 'volume-d49eb634-7340-48e7-bc18-0bb51de50094', 'volume_size': 2, 'source_volid': '52a02eff-fff5-427d-9df6-979a1ff58750', 'source_volstatus': 'available'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffea275-9c6a-4474-96d2-c15b4dcf2301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffea275-9c6a-4474-96d2-c15b4dcf2301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24748bbc-c2c9-4ac5-82c1-5b8035db7b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:31 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Volume d49eb634-7340-48e7-bc18-0bb51de50094: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d49eb634-7340-48e7-bc18-0bb51de50094', 'volume_size': 2, 'source_volid': '52a02eff-fff5-427d-9df6-979a1ff58750', 'source_volstatus': 'available'}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d9a46b9-26b5-419e-813a-5b13005889fb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:31 devstack sudo[101909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d9a46b9-26b5-419e-813a-5b13005889fb
Aug 04 09:28:31 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:31 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:31 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] group_snapshot befad733-a4c3-4034-a33d-8cb8402830cf: deleting
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.285s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:31 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1d203e88-fdcb-4400-a02b-b05bda951fb3 tempest-GroupSnapshotsTest-1723145840 None] Delete group completed successfully.
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] group_snapshot befad733-a4c3-4034-a33d-8cb8402830cf: deleting {{(pid=88880) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 04 09:28:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-13759691-4e7f-4490-9f25-b4a19da31956" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-13759691-4e7f-4490-9f25-b4a19da31956" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-f4a06003-0851-4a18-8181-e4cff58aa722" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-f4a06003-0851-4a18-8181-e4cff58aa722" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Deleting offline snapshot f4a06003-0851-4a18-8181-e4cff58aa722 of volume 13759691-4e7f-4490-9f25-b4a19da31956 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] snapshot_file for this snap is: volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e2ffc2-47ad-4cf8-9ae2-d427ea3a5abd]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:32 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d9a46b9-26b5-419e-813a-5b13005889fb" returned: 0 in 0.279s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.301s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:32 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Cloning volume 52a02eff-fff5-427d-9df6-979a1ff58750 to volume d49eb634-7340-48e7-bc18-0bb51de50094
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d55cc43-db59-406f-9345-4b38d5455dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9a46b9-26b5-419e-813a-5b13005889fb', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd4a8f7-4661-4f7d-b72b-02400df6bd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:32 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Volume volume-9d9a46b9-26b5-419e-813a-5b13005889fb (9d9a46b9-26b5-419e-813a-5b13005889fb): created successfully
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd4a8f7-4661-4f7d-b72b-02400df6bd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:32 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722
Aug 04 09:28:32 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Flow 'volume_create_manager' (a1de11ed-63d3-4891-8646-4f97f17e3283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Creating offline snapshot cd9887b6-5216-4cf5-827a-d48fa2d0da08 of volume 52a02eff-fff5-427d-9df6-979a1ff58750 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:28:32 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3422c5ef-cb1d-491d-a968-49dd3b420d73 tempest-VolumesNegativeTest-1492208270 None] Created volume successfully.
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8e3464-da92-4045-84a4-f558e5a4a9f7]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:32 devstack sudo[101915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750
Aug 04 09:28:32 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:32 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722" returned: 0 in 0.387s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13759691-4e7f-4490-9f25-b4a19da31956(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9ed536-4ab9-4111-b05b-1f18ffc6f676]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:32 devstack sudo[101920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956
Aug 04 09:28:32 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:32 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750" returned: 0 in 0.381s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:32 devstack sudo[101925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08 1G
Aug 04 09:28:32 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:32 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956" returned: 0 in 0.370s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:32 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722
Aug 04 09:28:32 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:33 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08 1G" returned: 0 in 0.412s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52a02eff-fff5-427d-9df6-979a1ff58750 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:33 devstack sudo[101936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52a02eff-fff5-427d-9df6-979a1ff58750 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08
Aug 04 09:28:33 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:33 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722" returned: 0 in 0.442s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:33 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722
Aug 04 09:28:33 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:33 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52a02eff-fff5-427d-9df6-979a1ff58750 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08" returned: 0 in 0.401s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:33 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08 is being set with open permissions: ugo+rw
Aug 04 09:28:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:33 devstack sudo[101946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08
Aug 04 09:28:33 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:33 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956.f4a06003-0851-4a18-8181-e4cff58aa722" returned: 0 in 0.305s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-f4a06003-0851-4a18-8181-e4cff58aa722" released by "_delete_snapshot" :: held 1.628s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-13759691-4e7f-4490-9f25-b4a19da31956" released by "delete_snapshot" :: held 1.651s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:33 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08" returned: 0 in 0.305s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:33 devstack cinder-volume[88880]: WARNING cinder.quota [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1132120374 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1132120374, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:28:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:33 devstack sudo[101950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.info
Aug 04 09:28:33 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:33 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['73884a66-3fc0-420a-bdad-71c8233780ed', '1f702b2f-3a3b-48f6-9868-524d9b2c96fd', '74474487-9f03-4783-929f-c182bafb33ee', '85457875-b333-4abb-858b-3ca34423b76b'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:33 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e0fa8f1d-cbd9-4e11-a4fd-0071fb3c8340 tempest-GroupSnapshotsTest-1723145840 None] group_snapshot befad733-a4c3-4034-a33d-8cb8402830cf: deleted successfully
Aug 04 09:28:34 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.info" returned: 0 in 0.296s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:34 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.info is being set with open permissions: ugo+rw
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:34 devstack sudo[101953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.info
Aug 04 09:28:34 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:34 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.info" returned: 0 in 0.302s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Acquiring lock "cinder-quobyte-d49eb634-7340-48e7-bc18-0bb51de50094" by "_copy_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Lock "cinder-quobyte-d49eb634-7340-48e7-bc18-0bb51de50094" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] snapshot: cd9887b6-5216-4cf5-827a-d48fa2d0da08, volume: d49eb634-7340-48e7-bc18-0bb51de50094,  {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[df69da7a-27be-4009-b8ad-d8a0a1af382f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:34 devstack sudo[101959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08
Aug 04 09:28:34 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-13759691-4e7f-4490-9f25-b4a19da31956" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-13759691-4e7f-4490-9f25-b4a19da31956" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd3befd-89e7-4fce-96a0-fd325516bf33]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:34 devstack sudo[101961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956
Aug 04 09:28:34 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:34 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08" returned: 0 in 0.470s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52a02eff-fff5-427d-9df6-979a1ff58750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Creating direct copy from snapshot {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ddc596-b1d5-4936-97e2-8a0582185d0a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:35 devstack sudo[101966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750
Aug 04 09:28:35 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:35 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956" returned: 0 in 0.412s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:35 devstack sudo[101971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956
Aug 04 09:28:35 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:35 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750" returned: 0 in 0.436s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG cinder.utils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Path /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094 not found in is_blk_device check {{(pid=88880) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:35 devstack sudo[101976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094
Aug 04 09:28:35 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:35 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-13759691-4e7f-4490-9f25-b4a19da31956" returned: 0 in 0.283s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-13759691-4e7f-4490-9f25-b4a19da31956" released by "delete_volume" :: held 0.810s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['bde15733-4513-4449-8086-4386da5cd63e'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:35 devstack cinder-volume[88880]: WARNING cinder.db.api [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1132120374']
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['3dc128d1-e68c-4864-baae-0d171cacaae0', '4e16239a-2219-4a1c-8e02-2139636a782b', 'f35a367e-da7b-4378-a185-4b5e195cb36f', '4a3f4324-db2b-47be-98e3-75fceacaecb1'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:35 devstack sudo[101983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:35 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:36 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.545s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:36 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:36 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-c75aa44a-7a16-4045-966d-f4a7108fae8b tempest-GroupSnapshotsTest-1723145840 None] Delete group completed successfully.
Aug 04 09:28:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-69186b9b-6d75-405b-98a8-b6791a18037d tempest-GroupSnapshotsTest-1723145840 None] Group tempest-GroupSnapshotsTest-Group-1078650173: creating
Aug 04 09:28:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-69186b9b-6d75-405b-98a8-b6791a18037d tempest-GroupSnapshotsTest-1723145840 None] Group tempest-GroupSnapshotsTest-Group-1078650173: created successfully
Aug 04 09:28:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-69186b9b-6d75-405b-98a8-b6791a18037d tempest-GroupSnapshotsTest-1723145840 None] Create group completed successfully.
Aug 04 09:28:39 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:28:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Flow 'volume_create_manager' (4ca7b6f7-6312-41ba-bac6-7861d80aa05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b553c9-7128-4042-a9f7-bd6fafa2bb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b553c9-7128-4042-a9f7-bd6fafa2bb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2022662843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=98e7125e-df18-48fd-9003-ef52545b6974,host='devstack@QuobyteHD#QuobyteHD',id=8793aa6a-8ff3-4933-8088-c9855bb15035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0773194052493880145aecd29623c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:39Z,use_quota=True,user_id='8649aef2b920484fbc9fe462ae3fb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(235eff30-0656-46e5-8c15-c5e4a49e8641),volume_type_id=235eff30-0656-46e5-8c15-c5e4a49e8641)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a155fb1a-3c72-4827-9f2c-01504faa8e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a155fb1a-3c72-4827-9f2c-01504faa8e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938eefec-8313-4c97-8125-1befc399f21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938eefec-8313-4c97-8125-1befc399f21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8793aa6a-8ff3-4933-8088-c9855bb15035', 'volume_name': 'volume-8793aa6a-8ff3-4933-8088-c9855bb15035', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141f1614-fac3-4762-b893-b2eea673c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141f1614-fac3-4762-b893-b2eea673c70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea66ed1-b8c6-4437-93b2-c8c005dd29f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:39 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Volume 8793aa6a-8ff3-4933-8088-c9855bb15035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8793aa6a-8ff3-4933-8088-c9855bb15035', 'volume_size': 1}
Aug 04 09:28:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:41 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094" returned: 0 in 5.930s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:41 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa010a32-149d-4ce5-967c-0409d9812a2a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:41 devstack sudo[102045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750
Aug 04 09:28:41 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:41 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750" returned: 0 in 0.591s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:41 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:28:41 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Converted 1024.00 MB image at 172.66 MB/s
Aug 04 09:28:41 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094 is being set with open permissions: ugo+rw
Aug 04 09:28:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:41 devstack sudo[102051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094
Aug 04 09:28:41 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:42 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094" returned: 0 in 0.273s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Lock "cinder-quobyte-d49eb634-7340-48e7-bc18-0bb51de50094" released by "_copy_volume_from_snapshot" :: held 7.814s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Acquiring lock "cinder-quobyte-cd9887b6-5216-4cf5-827a-d48fa2d0da08" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Lock "cinder-quobyte-cd9887b6-5216-4cf5-827a-d48fa2d0da08" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Deleting offline snapshot cd9887b6-5216-4cf5-827a-d48fa2d0da08 of volume 52a02eff-fff5-427d-9df6-979a1ff58750 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:28:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] snapshot_file for this snap is: volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:28:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3390d-8268-475e-9903-2f3944e51ab3]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:42 devstack sudo[102054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08
Aug 04 09:28:42 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:43 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08" returned: 0 in 0.718s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52a02eff-fff5-427d-9df6-979a1ff58750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:28:43 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdac4cd2-2f5c-45e5-b732-60011db67887]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:43 devstack sudo[102097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750
Aug 04 09:28:43 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:43 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750" returned: 0 in 0.550s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:43 devstack sudo[102124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08
Aug 04 09:28:43 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:44 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08" returned: 0 in 0.385s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:44 devstack sudo[102152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08
Aug 04 09:28:44 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:44 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750.cd9887b6-5216-4cf5-827a-d48fa2d0da08" returned: 0 in 0.260s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Lock "cinder-quobyte-cd9887b6-5216-4cf5-827a-d48fa2d0da08" released by "_delete_snapshot" :: held 2.082s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.280s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.057s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=98e7125e-df18-48fd-9003-ef52545b6974,created_at=2026-08-04T07:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2022662843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=98e7125e-df18-48fd-9003-ef52545b6974,host='devstack@QuobyteHD#QuobyteHD',id=8793aa6a-8ff3-4933-8088-c9855bb15035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0773194052493880145aecd29623c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:39Z,use_quota=True,user_id='8649aef2b920484fbc9fe462ae3fb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(235eff30-0656-46e5-8c15-c5e4a49e8641),volume_type_id=235eff30-0656-46e5-8c15-c5e4a49e8641)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Creating volume 8793aa6a-8ff3-4933-8088-c9855bb15035 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:28:44 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:44 devstack sudo[102157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035 1073741824
Aug 04 09:28:44 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24748bbc-c2c9-4ac5-82c1-5b8035db7b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49eb634-7340-48e7-bc18-0bb51de50094', 'volume_size': 2, 'source_volid': '52a02eff-fff5-427d-9df6-979a1ff58750', 'source_volstatus': 'available'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083ea776-d8d2-4260-a1bd-bb859cc5c21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:44 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Volume volume-d49eb634-7340-48e7-bc18-0bb51de50094 (d49eb634-7340-48e7-bc18-0bb51de50094): created successfully
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083ea776-d8d2-4260-a1bd-bb859cc5c21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Flow 'volume_create_manager' (4179f36d-a504-4e59-8143-9ec2485f2b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-57c51bed-7f92-43e2-bb24-488be5c4c9ef tempest-VolumesCloneTest-1339312013 None] Created volume successfully.
Aug 04 09:28:45 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035 1073741824" returned: 0 in 0.697s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:45 devstack sudo[102171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035
Aug 04 09:28:45 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Acquiring lock "cinder-d49eb634-7340-48e7-bc18-0bb51de50094-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Lock "cinder-d49eb634-7340-48e7-bc18-0bb51de50094-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Acquiring lock "cinder-quobyte-d49eb634-7340-48e7-bc18-0bb51de50094" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Lock "cinder-quobyte-d49eb634-7340-48e7-bc18-0bb51de50094" acquired by "delete_volume" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22e1526-f288-4705-bb6e-cb5d05d75c34]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:45 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035" returned: 0 in 0.386s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:45 devstack sudo[102173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094
Aug 04 09:28:45 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea66ed1-b8c6-4437-93b2-c8c005dd29f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8793aa6a-8ff3-4933-8088-c9855bb15035', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d6c6f7-5f92-43be-bfcc-dc2af1c7d8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:45 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Volume volume-8793aa6a-8ff3-4933-8088-c9855bb15035 (8793aa6a-8ff3-4933-8088-c9855bb15035): created successfully
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d6c6f7-5f92-43be-bfcc-dc2af1c7d8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Flow 'volume_create_manager' (4ca7b6f7-6312-41ba-bac6-7861d80aa05d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:45 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-364e534d-639d-4f1d-a44e-443ce4a9bcc2 tempest-GroupSnapshotsTest-1723145840 None] Created volume successfully.
Aug 04 09:28:45 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094" returned: 0 in 0.515s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:46 devstack sudo[102179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094
Aug 04 09:28:46 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:46 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d49eb634-7340-48e7-bc18-0bb51de50094" returned: 0 in 0.306s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Lock "cinder-quobyte-d49eb634-7340-48e7-bc18-0bb51de50094" released by "delete_volume" :: held 0.885s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Created reservations ['65781bd0-4cdf-432f-a693-ed334af2cdf6', 'abbbe653-1f2b-4c5a-b95e-b9b78b73001c', '05a127d3-8a66-4f29-826a-5eb6469dd753', '0c7fc13d-e916-4b10-9745-942ad25cf3f6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:46 devstack sudo[102186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:46 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Acquiring lock "cinder-52a02eff-fff5-427d-9df6-979a1ff58750-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Lock "cinder-52a02eff-fff5-427d-9df6-979a1ff58750-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Acquiring lock "cinder-quobyte-52a02eff-fff5-427d-9df6-979a1ff58750" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Lock "cinder-quobyte-52a02eff-fff5-427d-9df6-979a1ff58750" acquired by "delete_volume" :: waited 0.030s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:46 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.457s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:46 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Deleted volume successfully.
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cac987-1ab0-40eb-9de8-545306048859]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d583efbb-eb8f-4c12-b3b0-3fb825fc871c tempest-VolumesCloneTest-1339312013 None] Lock "cinder-d49eb634-7340-48e7-bc18-0bb51de50094-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:47 devstack sudo[102207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750
Aug 04 09:28:47 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:47 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750" returned: 0 in 0.529s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:47 devstack sudo[102213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750
Aug 04 09:28:47 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Flow 'volume_create_manager' (afa6f0f2-98b7-48ed-a7b7-ba233250f1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf6d60e-52b1-48a0-b560-2f8043de162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf6d60e-52b1-48a0-b560-2f8043de162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-60468528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=98e7125e-df18-48fd-9003-ef52545b6974,host='devstack@QuobyteHD#QuobyteHD',id=f6fda537-7fd8-4453-ace5-e83087752889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0773194052493880145aecd29623c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:48Z,use_quota=True,user_id='8649aef2b920484fbc9fe462ae3fb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(235eff30-0656-46e5-8c15-c5e4a49e8641),volume_type_id=235eff30-0656-46e5-8c15-c5e4a49e8641)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70eb2c40-1c8b-4350-b1a2-23b8cd03d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70eb2c40-1c8b-4350-b1a2-23b8cd03d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402160d8-5eef-40ba-8c61-94474681b041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402160d8-5eef-40ba-8c61-94474681b041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6fda537-7fd8-4453-ace5-e83087752889', 'volume_name': 'volume-f6fda537-7fd8-4453-ace5-e83087752889', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae875bd-e705-49df-98ac-4cd7fc5154f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae875bd-e705-49df-98ac-4cd7fc5154f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5458ed8f-3d69-44fa-b8a1-47d3b4983a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:47 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Volume f6fda537-7fd8-4453-ace5-e83087752889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6fda537-7fd8-4453-ace5-e83087752889', 'volume_size': 1}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=98e7125e-df18-48fd-9003-ef52545b6974,created_at=2026-08-04T07:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-60468528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=98e7125e-df18-48fd-9003-ef52545b6974,host='devstack@QuobyteHD#QuobyteHD',id=f6fda537-7fd8-4453-ace5-e83087752889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0773194052493880145aecd29623c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:28:48Z,use_quota=True,user_id='8649aef2b920484fbc9fe462ae3fb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(235eff30-0656-46e5-8c15-c5e4a49e8641),volume_type_id=235eff30-0656-46e5-8c15-c5e4a49e8641)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Creating volume f6fda537-7fd8-4453-ace5-e83087752889 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:28:47 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:47 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52a02eff-fff5-427d-9df6-979a1ff58750" returned: 0 in 0.392s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:47 devstack sudo[102216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889 1073741824
Aug 04 09:28:47 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Lock "cinder-quobyte-52a02eff-fff5-427d-9df6-979a1ff58750" released by "delete_volume" :: held 1.036s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:47 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Created reservations ['80430472-8cc6-498b-bae6-d06bab53df70', '731ae35c-3a26-4615-8986-929bb140002d', '781fdddd-3bc4-4933-8415-aa0e46507e3e', 'b7a2f7cf-4bf5-499e-b920-1fd8ee1cecac'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:48 devstack sudo[102221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:48 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:48 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.279s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:48 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Deleted volume successfully.
Aug 04 09:28:48 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889 1073741824" returned: 0 in 0.555s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d1e3b7ed-5981-4782-a7d0-2f172ab00b02 tempest-VolumesCloneTest-1339312013 None] Lock "cinder-52a02eff-fff5-427d-9df6-979a1ff58750-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:48 devstack sudo[102228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889
Aug 04 09:28:48 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:48 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889" returned: 0 in 0.254s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5458ed8f-3d69-44fa-b8a1-47d3b4983a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fda537-7fd8-4453-ace5-e83087752889', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51dd6488-81af-482b-890c-28799fa72224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:28:48 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Volume volume-f6fda537-7fd8-4453-ace5-e83087752889 (f6fda537-7fd8-4453-ace5-e83087752889): created successfully
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51dd6488-81af-482b-890c-28799fa72224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:28:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Flow 'volume_create_manager' (afa6f0f2-98b7-48ed-a7b7-ba233250f1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:28:48 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9dbe9cb6-8fff-46e9-afa1-d42ecb23e1a0 tempest-GroupSnapshotsTest-1723145840 None] Created volume successfully.
Aug 04 09:28:48 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-90bfb218-144e-4d1b-aa7d-bbc7d7793b05 tempest-GroupSnapshotsTest-1723145840 None] Update group completed successfully.
Aug 04 09:28:50 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-50b5b67c-628f-43f5-bcad-a677ab0f35a8 tempest-GroupSnapshotsTest-1723145840 None] Update group completed successfully.
Aug 04 09:28:51 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b7255320-5b5b-4bec-afa1-8eee8240a23a tempest-GroupSnapshotsTest-1723145840 None] Update group completed successfully.
Aug 04 09:28:52 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-14b44af9-da15-4841-a42e-6a17950c7e04 tempest-GroupSnapshotsTest-1723145840 None] Update group completed successfully.
Aug 04 09:28:54 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] GroupSnapshot fdebcfe0-66a1-4618-9c30-03d13235827e: creating.
Aug 04 09:28:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Group snapshot fdebcfe0-66a1-4618-9c30-03d13235827e: creating. {{(pid=88880) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 04 09:28:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Creating offline snapshot 02ec722a-eb99-4fce-9509-f0b54947c083 of volume 8793aa6a-8ff3-4933-8088-c9855bb15035 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:28:54 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[58866d9f-ccce-4581-b941-311a90b57f87]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:54 devstack sudo[102240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035
Aug 04 09:28:54 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:54 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035" returned: 0 in 0.432s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:54 devstack sudo[102245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083 1G
Aug 04 09:28:54 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:55 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083 1G" returned: 0 in 0.563s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8793aa6a-8ff3-4933-8088-c9855bb15035 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:55 devstack sudo[102251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8793aa6a-8ff3-4933-8088-c9855bb15035 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083
Aug 04 09:28:55 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Acquiring lock "cinder-9d9a46b9-26b5-419e-813a-5b13005889fb-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Lock "cinder-9d9a46b9-26b5-419e-813a-5b13005889fb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Acquiring lock "cinder-quobyte-9d9a46b9-26b5-419e-813a-5b13005889fb" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Lock "cinder-quobyte-9d9a46b9-26b5-419e-813a-5b13005889fb" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[15789464-7554-4a6c-ab58-23ca883c0cd3]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d9a46b9-26b5-419e-813a-5b13005889fb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:55 devstack sudo[102253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d9a46b9-26b5-419e-813a-5b13005889fb
Aug 04 09:28:55 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:55 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8793aa6a-8ff3-4933-8088-c9855bb15035 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083" returned: 0 in 0.386s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:55 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083 is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:55 devstack sudo[102258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083
Aug 04 09:28:55 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:55 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d9a46b9-26b5-419e-813a-5b13005889fb" returned: 0 in 0.396s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d9a46b9-26b5-419e-813a-5b13005889fb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:55 devstack sudo[102264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d9a46b9-26b5-419e-813a-5b13005889fb
Aug 04 09:28:55 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:55 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083" returned: 0 in 0.260s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=142,cinder:INSERT=58,cinder:UPDATE=178,cinder:DELETE=17 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=173,cinder:INSERT=43,cinder:UPDATE=214,cinder:DELETE=12 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:28:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:55 devstack sudo[102267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.info
Aug 04 09:28:55 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:56 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9d9a46b9-26b5-419e-813a-5b13005889fb" returned: 0 in 0.265s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Lock "cinder-quobyte-9d9a46b9-26b5-419e-813a-5b13005889fb" released by "delete_volume" :: held 0.710s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Created reservations ['9d5ea6a2-cb08-460e-a03d-e97860456062', '1a92269b-1fd9-4491-8bf7-9f41838a3e74', 'acfd471f-c7f0-4406-a7c8-659a31e585a8', 'e1ce9a03-e36f-4929-9947-230f09e18669'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:28:56 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.info" returned: 0 in 0.287s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:56 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:56 devstack sudo[102271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.info
Aug 04 09:28:56 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:56 devstack sudo[102273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:28:56 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:56 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:56 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.info" returned: 0 in 0.366s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.394s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:28:56 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Deleted volume successfully.
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Creating offline snapshot 64c98418-7d9e-400d-9116-dea55b43bfe7 of volume f6fda537-7fd8-4453-ace5-e83087752889 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fa78c7ee-1dc3-480c-a312-ec2e7c59e418 tempest-VolumesNegativeTest-1492208270 None] Lock "cinder-9d9a46b9-26b5-419e-813a-5b13005889fb-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[18743b09-188d-44c0-8b4e-e0c10cdb9a50]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:56 devstack sudo[102277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889
Aug 04 09:28:56 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:57 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889" returned: 0 in 0.403s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:57 devstack sudo[102283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7 1G
Aug 04 09:28:57 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:57 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7 1G" returned: 0 in 0.550s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fda537-7fd8-4453-ace5-e83087752889 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:57 devstack sudo[102289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fda537-7fd8-4453-ace5-e83087752889 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7
Aug 04 09:28:57 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:58 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fda537-7fd8-4453-ace5-e83087752889 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7" returned: 0 in 0.387s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:58 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7 is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:28:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:58 devstack sudo[102294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7
Aug 04 09:28:58 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:58 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7" returned: 0 in 0.339s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:58 devstack sudo[102297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.info
Aug 04 09:28:58 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:58 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.info" returned: 0 in 0.370s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:58 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:28:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:58 devstack sudo[102300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.info
Aug 04 09:28:58 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:28:59 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root
Aug 04 09:28:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.info" returned: 0 in 0.295s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:28:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:28:59 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-859de8ae-6a8d-4f71-b950-45edffe51c13 tempest-GroupSnapshotsTest-1723145840 None] group_snapshot fdebcfe0-66a1-4618-9c30-03d13235827e: created successfully
Aug 04 09:28:59 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] group_snapshot fdebcfe0-66a1-4618-9c30-03d13235827e: deleting
Aug 04 09:28:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] group_snapshot fdebcfe0-66a1-4618-9c30-03d13235827e: deleting {{(pid=88880) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 04 09:28:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-8793aa6a-8ff3-4933-8088-c9855bb15035" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-8793aa6a-8ff3-4933-8088-c9855bb15035" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-02ec722a-eb99-4fce-9509-f0b54947c083" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:28:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-02ec722a-eb99-4fce-9509-f0b54947c083" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:28:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Deleting offline snapshot 02ec722a-eb99-4fce-9509-f0b54947c083 of volume 8793aa6a-8ff3-4933-8088-c9855bb15035 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:28:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] snapshot_file for this snap is: volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:28:59 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[738dbebd-04e2-4f0f-b25d-64b136fcbdb2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:28:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:28:59 devstack sudo[102304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083
Aug 04 09:28:59 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:00 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083" returned: 0 in 0.447s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8793aa6a-8ff3-4933-8088-c9855bb15035(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:29:00 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[401680bb-6e4b-49f9-8366-79ab06d24ad1]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:00 devstack sudo[102309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035
Aug 04 09:29:00 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:00 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035" returned: 0 in 0.430s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:00 devstack sudo[102314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083
Aug 04 09:29:00 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:01 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083" returned: 0 in 0.466s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:01 devstack sudo[102320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083
Aug 04 09:29:01 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:01 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035.02ec722a-eb99-4fce-9509-f0b54947c083" returned: 0 in 0.348s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-02ec722a-eb99-4fce-9509-f0b54947c083" released by "_delete_snapshot" :: held 1.861s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-8793aa6a-8ff3-4933-8088-c9855bb15035" released by "delete_snapshot" :: held 1.886s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-f6fda537-7fd8-4453-ace5-e83087752889" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-f6fda537-7fd8-4453-ace5-e83087752889" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-64c98418-7d9e-400d-9116-dea55b43bfe7" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-64c98418-7d9e-400d-9116-dea55b43bfe7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Deleting offline snapshot 64c98418-7d9e-400d-9116-dea55b43bfe7 of volume f6fda537-7fd8-4453-ace5-e83087752889 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] snapshot_file for this snap is: volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6e080a-90fd-4636-80c0-2fcaf95f1037]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:01 devstack sudo[102323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7
Aug 04 09:29:01 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:02 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7" returned: 0 in 0.460s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6fda537-7fd8-4453-ace5-e83087752889(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf627f5-4042-4ef1-92df-70c4ce0d7dfe]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:02 devstack sudo[102328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889
Aug 04 09:29:02 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Flow 'volume_create_manager' (1d116f7d-9b3f-4d88-b7db-72a952686b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9305ac5-e16e-4d96-a7e9-84c0998ffe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9305ac5-e16e-4d96-a7e9-84c0998ffe17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1121428881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9f2125-8f79-4a3e-ada6-cffae10ff6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ac4b910a05412cb0970fc5a43aedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:03Z,use_quota=True,user_id='d85ff6513d7f40a3af128c3e8e988f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6e8f89-f06c-4cd5-a891-4628d38100cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6e8f89-f06c-4cd5-a891-4628d38100cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a3dde5-dbaf-484a-8b23-41b4282e2c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a3dde5-dbaf-484a-8b23-41b4282e2c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9f2125-8f79-4a3e-ada6-cffae10ff6cd', 'volume_name': 'volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52776205-e0e2-4750-a262-1bfa6080e282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52776205-e0e2-4750-a262-1bfa6080e282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e77dec-7b43-4533-8b9a-28870a0ffe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:02 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Volume 6f9f2125-8f79-4a3e-ada6-cffae10ff6cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd', 'volume_size': 1}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1121428881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9f2125-8f79-4a3e-ada6-cffae10ff6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ac4b910a05412cb0970fc5a43aedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:03Z,use_quota=True,user_id='d85ff6513d7f40a3af128c3e8e988f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Creating volume 6f9f2125-8f79-4a3e-ada6-cffae10ff6cd {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:29:02 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:02 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889" returned: 0 in 0.428s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:02 devstack sudo[102333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd 1073741824
Aug 04 09:29:02 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:02 devstack sudo[102334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7
Aug 04 09:29:02 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:03 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7" returned: 0 in 0.340s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:03 devstack sudo[102345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7
Aug 04 09:29:03 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:03 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd 1073741824" returned: 0 in 0.463s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:03 devstack sudo[102349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd
Aug 04 09:29:03 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:03 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889.64c98418-7d9e-400d-9116-dea55b43bfe7" returned: 0 in 0.286s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-64c98418-7d9e-400d-9116-dea55b43bfe7" released by "_delete_snapshot" :: held 1.669s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-f6fda537-7fd8-4453-ace5-e83087752889" released by "delete_snapshot" :: held 1.694s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:03 devstack cinder-volume[88880]: WARNING cinder.quota [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2007734059 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2007734059, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:29:03 devstack cinder-volume[88880]: WARNING cinder.quota [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2007734059 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2007734059, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['f2c9eb5e-25a1-4bca-a9e8-fd85607e6836', '7b406c77-857e-4a12-b2d0-d9a4716a7976', 'c91eb74c-b695-48ef-bb31-dd009d697fe1', '2298379d-0e21-4b16-bc07-b1dc5e817068'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:03 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd" returned: 0 in 0.340s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e77dec-7b43-4533-8b9a-28870a0ffe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e8534d-c0ad-411c-81ee-2d2e5a24817c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:03 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Volume volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd (6f9f2125-8f79-4a3e-ada6-cffae10ff6cd): created successfully
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e8534d-c0ad-411c-81ee-2d2e5a24817c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Flow 'volume_create_manager' (1d116f7d-9b3f-4d88-b7db-72a952686b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:03 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-aee2b34e-5bfe-4f69-b69c-787557525f2c tempest-VolumesSnapshotTestJSON-503509665 None] Created volume successfully.
Aug 04 09:29:03 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['d9df6307-e3b1-4fea-92c0-58db9a1413dd', '81f6347b-a350-4fed-b971-aef446148257', 'e09dd3c6-0fd0-4786-8e82-8b9d9cba519f', 'ee4f2be3-14a7-4d61-8761-ed471b212d24'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:03 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a44fc862-7a65-4bf4-955a-4efef7f24264 tempest-GroupSnapshotsTest-1723145840 None] group_snapshot fdebcfe0-66a1-4618-9c30-03d13235827e: deleted successfully
Aug 04 09:29:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-8793aa6a-8ff3-4933-8088-c9855bb15035" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-8793aa6a-8ff3-4933-8088-c9855bb15035" acquired by "delete_volume" :: waited 0.030s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:04 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d031720-f471-4887-b675-5820f9aa8983]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] Creating offline snapshot a713929a-3968-4f22-a50c-31af6574ce0a of volume 6f9f2125-8f79-4a3e-ada6-cffae10ff6cd {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:29:05 devstack sudo[102353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035
Aug 04 09:29:05 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a875f7b-d89e-40f6-ba29-f9fbedf8059b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:05 devstack sudo[102355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd
Aug 04 09:29:05 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:05 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035" returned: 0 in 0.453s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:05 devstack sudo[102360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035
Aug 04 09:29:05 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:05 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd" returned: 0 in 0.470s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:05 devstack sudo[102365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a 1G
Aug 04 09:29:05 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:05 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8793aa6a-8ff3-4933-8088-c9855bb15035" returned: 0 in 0.298s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-8793aa6a-8ff3-4933-8088-c9855bb15035" released by "delete_volume" :: held 0.863s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-f6fda537-7fd8-4453-ace5-e83087752889" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-f6fda537-7fd8-4453-ace5-e83087752889" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ca0c0f-40c5-43db-8aae-1d15005cc441]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:05 devstack sudo[102368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889
Aug 04 09:29:05 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:06 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a 1G" returned: 0 in 0.514s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:06 devstack sudo[102374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a
Aug 04 09:29:06 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:06 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889" returned: 0 in 0.502s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:06 devstack sudo[102380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889
Aug 04 09:29:06 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:06 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a" returned: 0 in 0.383s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:06 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a is being set with open permissions: ugo+rw
Aug 04 09:29:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:06 devstack sudo[102386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a
Aug 04 09:29:06 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:06 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f6fda537-7fd8-4453-ace5-e83087752889" returned: 0 in 0.328s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-f6fda537-7fd8-4453-ace5-e83087752889" released by "delete_volume" :: held 0.917s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:06 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['4e336eee-9404-4cd5-b476-20a486d52f54'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:06 devstack cinder-volume[88880]: WARNING cinder.quota [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2007734059 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2007734059, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:29:06 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a" returned: 0 in 0.359s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:06 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['b4bb33cc-b5d0-4598-9283-6a2537c08586', 'ed3d8ce8-dae3-4fb4-92ea-d67b6c8a6bb2', 'bcb34c1e-d8ce-42b8-83d7-ff08326e8c79', '0baf4b54-6e24-4576-8763-078d7897dab7'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:06 devstack sudo[102390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.info
Aug 04 09:29:06 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['17fce92e-db37-49db-82c4-41204672f837', 'b4e0abe7-0201-4042-8229-1c59e375368e', '909d6e1a-1c0c-4e44-9466-e9b854c8125f', '1e2b76e8-b10e-4536-8f8a-10d7537750d9'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:07 devstack sudo[102393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:29:07 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:07 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.info" returned: 0 in 0.351s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:07 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.info is being set with open permissions: ugo+rw
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:07 devstack sudo[102395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.info
Aug 04 09:29:07 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:07 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.456s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:29:07 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f3a89162-7bac-4c23-a33d-8d86c3f9ff80 tempest-GroupSnapshotsTest-1723145840 None] Delete group completed successfully.
Aug 04 09:29:07 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.info" returned: 0 in 0.448s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.645s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:07 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-981c0111-a9c7-4551-b703-98e6497f7ac7 tempest-VolumesSnapshotTestJSON-503509665 None] Create snapshot completed successfully
Aug 04 09:29:07 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-84d2b1c7-965e-4f29-bb53-93a138d88e59 tempest-GroupSnapshotsTest-1723145840 None] Group tempest-GroupSnapshotsTest-Group-1550869039: creating
Aug 04 09:29:07 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-84d2b1c7-965e-4f29-bb53-93a138d88e59 tempest-GroupSnapshotsTest-1723145840 None] Group tempest-GroupSnapshotsTest-Group-1550869039: created successfully
Aug 04 09:29:07 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-84d2b1c7-965e-4f29-bb53-93a138d88e59 tempest-GroupSnapshotsTest-1723145840 None] Create group completed successfully.
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:08 devstack sudo[102399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:29:08 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:08 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.270s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-a713929a-3968-4f22-a50c-31af6574ce0a-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-a713929a-3968-4f22-a50c-31af6574ce0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-a713929a-3968-4f22-a50c-31af6574ce0a" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-a713929a-3968-4f22-a50c-31af6574ce0a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Deleting offline snapshot a713929a-3968-4f22-a50c-31af6574ce0a of volume 6f9f2125-8f79-4a3e-ada6-cffae10ff6cd {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] snapshot_file for this snap is: volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[45708a83-7b4d-40da-baae-492274d784e3]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:08 devstack sudo[102402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a
Aug 04 09:29:08 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:09 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a" returned: 0 in 0.392s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51f1d1f-10ac-4884-97c8-ecb4786185e0]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:09 devstack sudo[102408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd
Aug 04 09:29:09 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:09 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd" returned: 0 in 0.428s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:09 devstack sudo[102414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a
Aug 04 09:29:09 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Flow 'volume_create_manager' (48837960-89e2-4729-8ea7-76e7f9f90707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb236810-0160-4387-aee3-1be002821f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb236810-0160-4387-aee3-1be002821f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-669539085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cff44f2a-58c8-4c92-9454-826248a14f2f,host='devstack@QuobyteHD#QuobyteHD',id=cd49734f-d0e8-4595-b0cf-db5cdb2539fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0773194052493880145aecd29623c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:10Z,use_quota=True,user_id='8649aef2b920484fbc9fe462ae3fb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d607849-502b-4690-95a9-f1b9f821d298),volume_type_id=6d607849-502b-4690-95a9-f1b9f821d298)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c5116d-647f-4c1b-997a-00ef6c44ae26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c5116d-647f-4c1b-997a-00ef6c44ae26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4976baa-998b-4055-8ba1-8d685fab0188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4976baa-998b-4055-8ba1-8d685fab0188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd49734f-d0e8-4595-b0cf-db5cdb2539fa', 'volume_name': 'volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e85534a-6fba-4ea0-a299-7a9dd4eb0f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e85534a-6fba-4ea0-a299-7a9dd4eb0f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97c41a2-8b13-434c-8385-8d39bd1e96f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:09 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Volume cd49734f-d0e8-4595-b0cf-db5cdb2539fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa', 'volume_size': 1}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cff44f2a-58c8-4c92-9454-826248a14f2f,created_at=2026-08-04T07:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-669539085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cff44f2a-58c8-4c92-9454-826248a14f2f,host='devstack@QuobyteHD#QuobyteHD',id=cd49734f-d0e8-4595-b0cf-db5cdb2539fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0773194052493880145aecd29623c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:10Z,use_quota=True,user_id='8649aef2b920484fbc9fe462ae3fb551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d607849-502b-4690-95a9-f1b9f821d298),volume_type_id=6d607849-502b-4690-95a9-f1b9f821d298)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Creating volume cd49734f-d0e8-4595-b0cf-db5cdb2539fa {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:29:09 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:29:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:09 devstack sudo[102420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa 1073741824
Aug 04 09:29:09 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:10 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a" returned: 0 in 0.533s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:10 devstack sudo[102422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a
Aug 04 09:29:10 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:10 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd.a713929a-3968-4f22-a50c-31af6574ce0a" returned: 0 in 0.293s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-a713929a-3968-4f22-a50c-31af6574ce0a" released by "_delete_snapshot" :: held 1.805s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd" released by "delete_snapshot" :: held 1.836s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:10 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa 1073741824" returned: 0 in 0.584s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Created reservations ['dc14769c-799f-4867-b0f1-fc7584c4cab1', 'd9b08e25-88a6-48b8-9b08-9f8f7b5c7fec', 'f38a6296-a59c-49b8-aff2-929d23a08502', '14d05b64-f374-4885-9093-4f1e093dd56b'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:10 devstack sudo[102429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa
Aug 04 09:29:10 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:10 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Delete snapshot completed successfully.
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6ff0f840-bed0-4dc6-8fc0-46a02c6b2de7 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-a713929a-3968-4f22-a50c-31af6574ce0a-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:10 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa" returned: 0 in 0.334s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97c41a2-8b13-434c-8385-8d39bd1e96f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39b60dd-7805-4cac-a7b1-34875180386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:10 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Volume volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa (cd49734f-d0e8-4595-b0cf-db5cdb2539fa): created successfully
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39b60dd-7805-4cac-a7b1-34875180386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Flow 'volume_create_manager' (48837960-89e2-4729-8ea7-76e7f9f90707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:10 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9406ee25-87db-4355-b1e1-7898bd40f8a8 tempest-GroupSnapshotsTest-1723145840 None] Created volume successfully.
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Flow 'volume_create_manager' (70300f8f-9bd0-48ba-9c67-ec4d8586dd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636d355f-f049-4f98-9c04-0fc867a3e51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636d355f-f049-4f98-9c04-0fc867a3e51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1688144559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e5dc50-097d-4907-b912-c0ed9cb132f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ac4b910a05412cb0970fc5a43aedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:11Z,use_quota=True,user_id='d85ff6513d7f40a3af128c3e8e988f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4e62f0-b59b-468e-bb9d-4266e3c8e8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4e62f0-b59b-468e-bb9d-4266e3c8e8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cf2e58-bf67-405a-89f9-09632d7c0616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cf2e58-bf67-405a-89f9-09632d7c0616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55e5dc50-097d-4907-b912-c0ed9cb132f7', 'volume_name': 'volume-55e5dc50-097d-4907-b912-c0ed9cb132f7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e90bbb-f9ab-4e80-a741-96f25be86304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e90bbb-f9ab-4e80-a741-96f25be86304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0af2f6-4069-42c6-a1de-44462fb76f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:11 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Volume 55e5dc50-097d-4907-b912-c0ed9cb132f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55e5dc50-097d-4907-b912-c0ed9cb132f7', 'volume_size': 1}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1688144559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e5dc50-097d-4907-b912-c0ed9cb132f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ac4b910a05412cb0970fc5a43aedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:11Z,use_quota=True,user_id='d85ff6513d7f40a3af128c3e8e988f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Creating volume 55e5dc50-097d-4907-b912-c0ed9cb132f7 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:29:11 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:11 devstack sudo[102432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 1073741824
Aug 04 09:29:11 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:11 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 1073741824" returned: 0 in 0.492s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:12 devstack sudo[102438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7
Aug 04 09:29:12 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:12 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7" returned: 0 in 0.303s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0af2f6-4069-42c6-a1de-44462fb76f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e5dc50-097d-4907-b912-c0ed9cb132f7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02aa0fe1-0fb5-46e4-b1e1-18840847bc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:12 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Volume volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 (55e5dc50-097d-4907-b912-c0ed9cb132f7): created successfully
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02aa0fe1-0fb5-46e4-b1e1-18840847bc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Flow 'volume_create_manager' (70300f8f-9bd0-48ba-9c67-ec4d8586dd7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:12 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-322ccdfa-ce65-4bdd-bb0a-bb23f387ab84 tempest-VolumesSnapshotTestJSON-503509665 None] Created volume successfully.
Aug 04 09:29:12 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] GroupSnapshot 6afe37b3-a170-4592-b68e-ec6622091466: creating.
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] Group snapshot 6afe37b3-a170-4592-b68e-ec6622091466: creating. {{(pid=88880) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] Creating offline snapshot 2051ff69-9be5-4d96-a8ad-db49fb462d93 of volume cd49734f-d0e8-4595-b0cf-db5cdb2539fa {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12d8ef3-eefd-4945-8ebf-1f3edb3c776b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:12 devstack sudo[102441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa
Aug 04 09:29:12 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:12 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa" returned: 0 in 0.372s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:12 devstack sudo[102446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93 1G
Aug 04 09:29:12 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:13 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93 1G" returned: 0 in 0.416s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:13 devstack sudo[102452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93
Aug 04 09:29:13 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:13 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93" returned: 0 in 0.300s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:13 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93 is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:29:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:13 devstack sudo[102457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93
Aug 04 09:29:13 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:13 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93" returned: 0 in 0.263s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:13 devstack sudo[102460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.info
Aug 04 09:29:13 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:14 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.info" returned: 0 in 0.259s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:14 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:14 devstack sudo[102463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.info
Aug 04 09:29:14 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:14 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.info" returned: 0 in 0.265s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.991s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.790s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] Creating offline snapshot a63f21fd-c111-41b8-a6e1-3ffde5c328fa of volume 55e5dc50-097d-4907-b912-c0ed9cb132f7 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9af790e-c8c5-4596-bd64-0277f2f6cb3e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:14 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d356bd74-2eb5-4c4f-adc6-269009a95896 tempest-GroupSnapshotsTest-1723145840 None] group_snapshot 6afe37b3-a170-4592-b68e-ec6622091466: created successfully
Aug 04 09:29:14 devstack sudo[102466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7
Aug 04 09:29:14 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:14 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] group_snapshot 6afe37b3-a170-4592-b68e-ec6622091466: deleting
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] group_snapshot 6afe37b3-a170-4592-b68e-ec6622091466: deleting {{(pid=88880) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-cd49734f-d0e8-4595-b0cf-db5cdb2539fa" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-cd49734f-d0e8-4595-b0cf-db5cdb2539fa" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-2051ff69-9be5-4d96-a8ad-db49fb462d93" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-2051ff69-9be5-4d96-a8ad-db49fb462d93" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Deleting offline snapshot 2051ff69-9be5-4d96-a8ad-db49fb462d93 of volume cd49734f-d0e8-4595-b0cf-db5cdb2539fa {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:29:14 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] snapshot_file for this snap is: volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7" returned: 0 in 0.499s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e580f2-e987-4333-a82a-c93af8ac87a6]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:15 devstack sudo[102471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa 1G
Aug 04 09:29:15 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:15 devstack sudo[102472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93
Aug 04 09:29:15 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:15 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93" returned: 0 in 0.402s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[580e346a-0966-4137-b723-18aca5c0fb42]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:15 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa 1G" returned: 0 in 0.526s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:15 devstack sudo[102484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa
Aug 04 09:29:15 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:15 devstack sudo[102483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa
Aug 04 09:29:15 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:15 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa" returned: 0 in 0.395s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:15 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa" returned: 0 in 0.331s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:15 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa is being set with open permissions: ugo+rw
Aug 04 09:29:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:15 devstack sudo[102493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93
Aug 04 09:29:15 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:15 devstack sudo[102494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa
Aug 04 09:29:15 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:16 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa" returned: 0 in 0.336s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:16 devstack sudo[102500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.info
Aug 04 09:29:16 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:16 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93" returned: 0 in 0.598s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:16 devstack sudo[102503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93
Aug 04 09:29:16 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:16 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.info" returned: 0 in 0.347s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:16 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.info is being set with open permissions: ugo+rw
Aug 04 09:29:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:16 devstack sudo[102506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.info
Aug 04 09:29:16 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:16 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa.2051ff69-9be5-4d96-a8ad-db49fb462d93" returned: 0 in 0.311s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-2051ff69-9be5-4d96-a8ad-db49fb462d93" released by "_delete_snapshot" :: held 1.861s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-cd49734f-d0e8-4595-b0cf-db5cdb2539fa" released by "delete_snapshot" :: held 1.897s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:16 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.info" returned: 0 in 0.276s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:16 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-86df148c-385e-4e45-af55-419ecda6f77d tempest-VolumesSnapshotTestJSON-503509665 None] Create snapshot completed successfully
Aug 04 09:29:16 devstack cinder-volume[88880]: WARNING cinder.quota [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-261731043 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-261731043, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:29:16 devstack cinder-volume[88880]: WARNING cinder.quota [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-261731043 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-261731043, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:29:16 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['6bed3983-6468-4e56-ab0b-d2ffa3026ae7', 'e08c8f84-385c-4c2e-ba0e-1910786ce7cf', 'c1a25aa1-4909-4647-9ec7-2315ebb20c6b', '15333a22-dc36-4c09-9510-77238a3a3c93'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:17 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e5c3a4d8-61cd-4f8e-b923-643ab94053f9 tempest-GroupSnapshotsTest-1723145840 None] group_snapshot 6afe37b3-a170-4592-b68e-ec6622091466: deleted successfully
Aug 04 09:29:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "cinder-quobyte-cd49734f-d0e8-4595-b0cf-db5cdb2539fa" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-cd49734f-d0e8-4595-b0cf-db5cdb2539fa" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:17 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d66dba3-43e3-40b8-9cac-272dbe105f0e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:17 devstack sudo[102510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa
Aug 04 09:29:17 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:18 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa" returned: 0 in 0.391s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:18 devstack sudo[102515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa
Aug 04 09:29:18 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:18 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-cd49734f-d0e8-4595-b0cf-db5cdb2539fa" returned: 0 in 0.289s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Lock "cinder-quobyte-cd49734f-d0e8-4595-b0cf-db5cdb2539fa" released by "delete_volume" :: held 0.766s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['889bf7ab-d01d-41be-b581-1ee4143e9e1b'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:18 devstack cinder-volume[88880]: WARNING cinder.quota [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-261731043 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-261731043, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Created reservations ['d346bcdf-a4f4-4f52-a3af-03ee63824e31', '52bda1dc-c081-46d7-a5fc-b4804fdb8a9f', '4526f032-24d1-4585-88a5-02caee68b93f', 'b91b8b64-f453-41ae-be28-d020f2c3edd2'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Flow 'volume_create_manager' (41a9652a-add3-4ce1-851f-bd4546c4d32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b800db-4643-4865-8e1b-672fd0f0e7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b800db-4643-4865-8e1b-672fd0f0e7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-8399854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718b5898-34f9-4d92-a5e2-f63ceb3298db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ac4b910a05412cb0970fc5a43aedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a63f21fd-c111-41b8-a6e1-3ffde5c328fa,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:19Z,use_quota=True,user_id='d85ff6513d7f40a3af128c3e8e988f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74797272-095f-45c5-adde-73ae862fd7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74797272-095f-45c5-adde-73ae862fd7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44566675-3106-41b6-bd32-cd85bcad8699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44566675-3106-41b6-bd32-cd85bcad8699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '718b5898-34f9-4d92-a5e2-f63ceb3298db', 'volume_name': 'volume-718b5898-34f9-4d92-a5e2-f63ceb3298db', 'volume_size': 2, 'snapshot_id': 'a63f21fd-c111-41b8-a6e1-3ffde5c328fa'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2431986-d65e-4abb-8ca8-53c03567cbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2431986-d65e-4abb-8ca8-53c03567cbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90eb796-e92b-44ea-99ea-778d79aa48d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:18 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Volume 718b5898-34f9-4d92-a5e2-f63ceb3298db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-718b5898-34f9-4d92-a5e2-f63ceb3298db', 'volume_size': 2, 'snapshot_id': 'a63f21fd-c111-41b8-a6e1-3ffde5c328fa'}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-a63f21fd-c111-41b8-a6e1-3ffde5c328fa-718b5898-34f9-4d92-a5e2-f63ceb3298db" by "_create_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-a63f21fd-c111-41b8-a6e1-3ffde5c328fa-718b5898-34f9-4d92-a5e2-f63ceb3298db" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Creating volume 718b5898-34f9-4d92-a5e2-f63ceb3298db from snapshot a63f21fd-c111-41b8-a6e1-3ffde5c328fa {{(pid=88880) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-718b5898-34f9-4d92-a5e2-f63ceb3298db" by "_copy_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-718b5898-34f9-4d92-a5e2-f63ceb3298db" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] snapshot: a63f21fd-c111-41b8-a6e1-3ffde5c328fa, volume: 718b5898-34f9-4d92-a5e2-f63ceb3298db,  {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Aug 04 09:29:18 devstack sudo[102518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:29:18 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f83ac4-11d3-47cb-a9d8-6830f7aba515]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:18 devstack sudo[102520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa
Aug 04 09:29:18 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:19 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.274s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:19 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:29:19 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-aeb97471-19d0-4ff4-912e-03ac6909c7d1 tempest-GroupSnapshotsTest-1723145840 None] Delete group completed successfully.
Aug 04 09:29:19 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa" returned: 0 in 0.400s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55e5dc50-097d-4907-b912-c0ed9cb132f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:29:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Aug 04 09:29:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Creating direct copy from snapshot {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Aug 04 09:29:19 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dc6300-bc48-4f46-855b-4f6cfe40c8c2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:19 devstack sudo[102527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7
Aug 04 09:29:19 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:19 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7" returned: 0 in 0.386s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:19 devstack cinder-volume[88880]: DEBUG cinder.utils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Path /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db not found in is_blk_device check {{(pid=88880) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 04 09:29:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:19 devstack sudo[102534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db
Aug 04 09:29:19 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:25 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db" returned: 0 in 5.548s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:25 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[71531eaf-94af-4718-9846-c9ef107619ce]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:25 devstack sudo[102548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7
Aug 04 09:29:25 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:25 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7" returned: 0 in 0.612s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:25 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:29:25 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Converted 1024.00 MB image at 184.50 MB/s
Aug 04 09:29:25 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db is being set with open permissions: ugo+rw
Aug 04 09:29:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:25 devstack sudo[102554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db
Aug 04 09:29:25 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:26 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db" returned: 0 in 0.261s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-718b5898-34f9-4d92-a5e2-f63ceb3298db" released by "_copy_volume_from_snapshot" :: held 7.342s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-a63f21fd-c111-41b8-a6e1-3ffde5c328fa-718b5898-34f9-4d92-a5e2-f63ceb3298db" released by "_create_volume_from_snapshot" :: held 7.409s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.443s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90eb796-e92b-44ea-99ea-778d79aa48d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-718b5898-34f9-4d92-a5e2-f63ceb3298db', 'volume_size': 2, 'snapshot_id': 'a63f21fd-c111-41b8-a6e1-3ffde5c328fa'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a973b30f-57b5-4fe5-b341-ed6a2a857e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:26 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Volume volume-718b5898-34f9-4d92-a5e2-f63ceb3298db (718b5898-34f9-4d92-a5e2-f63ceb3298db): created successfully
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a973b30f-57b5-4fe5-b341-ed6a2a857e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Flow 'volume_create_manager' (41a9652a-add3-4ce1-851f-bd4546c4d32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:26 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-47805a3a-551c-4a6e-9273-65e616855f1f tempest-VolumesSnapshotTestJSON-503509665 None] Created volume successfully.
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-718b5898-34f9-4d92-a5e2-f63ceb3298db-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-718b5898-34f9-4d92-a5e2-f63ceb3298db-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-718b5898-34f9-4d92-a5e2-f63ceb3298db" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-718b5898-34f9-4d92-a5e2-f63ceb3298db" acquired by "delete_volume" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3248130b-da56-439b-ac9e-465ea98b5f73]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:26 devstack sudo[102557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db
Aug 04 09:29:26 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:27 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db" returned: 0 in 0.403s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:27 devstack sudo[102562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db
Aug 04 09:29:27 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:27 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-718b5898-34f9-4d92-a5e2-f63ceb3298db" returned: 0 in 0.283s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-718b5898-34f9-4d92-a5e2-f63ceb3298db" released by "delete_volume" :: held 0.742s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Created reservations ['45ac84cb-a437-477e-8fa0-0c95e5be9c60', '9a365e7f-9d41-4af9-95eb-75379ae11bac', '0f285c73-84d7-4db0-a96e-2335189c4bb7', '7f6b2817-336e-4f42-a78e-7c9de2f4d4e1'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:27 devstack sudo[102565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:29:27 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-a63f21fd-c111-41b8-a6e1-3ffde5c328fa-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-a63f21fd-c111-41b8-a6e1-3ffde5c328fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-55e5dc50-097d-4907-b912-c0ed9cb132f7" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-55e5dc50-097d-4907-b912-c0ed9cb132f7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-a63f21fd-c111-41b8-a6e1-3ffde5c328fa" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:27 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.337s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:29:27 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Deleted volume successfully.
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-a63f21fd-c111-41b8-a6e1-3ffde5c328fa" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Deleting offline snapshot a63f21fd-c111-41b8-a6e1-3ffde5c328fa of volume 55e5dc50-097d-4907-b912-c0ed9cb132f7 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] snapshot_file for this snap is: volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-233e5d21-a614-44ec-b99c-07ed9f6ff1c8 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-718b5898-34f9-4d92-a5e2-f63ceb3298db-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36c06e6-8797-48f6-ae01-3fbdd7912590]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:28 devstack sudo[102570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa
Aug 04 09:29:28 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:28 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa" returned: 0 in 0.418s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55e5dc50-097d-4907-b912-c0ed9cb132f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:29:28 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bd37fb-78b1-43ec-bbd3-cbaa38bd16cd]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:28 devstack sudo[102576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7
Aug 04 09:29:28 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:28 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1ec68a3f-ca71-4bd6-b533-65764a03ea4e tempest-GroupSnapshotsV319Test-1929595041 None] Group tempest-GroupSnapshotsV319Test-Group-1490193676: creating
Aug 04 09:29:28 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1ec68a3f-ca71-4bd6-b533-65764a03ea4e tempest-GroupSnapshotsV319Test-1929595041 None] Group tempest-GroupSnapshotsV319Test-Group-1490193676: created successfully
Aug 04 09:29:28 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1ec68a3f-ca71-4bd6-b533-65764a03ea4e tempest-GroupSnapshotsV319Test-1929595041 None] Create group completed successfully.
Aug 04 09:29:28 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7" returned: 0 in 0.422s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:28 devstack sudo[102581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa
Aug 04 09:29:28 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:29 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa" returned: 0 in 0.381s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:29 devstack sudo[102587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa
Aug 04 09:29:29 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:29 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7.a63f21fd-c111-41b8-a6e1-3ffde5c328fa" returned: 0 in 0.282s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-a63f21fd-c111-41b8-a6e1-3ffde5c328fa" released by "_delete_snapshot" :: held 1.648s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-55e5dc50-097d-4907-b912-c0ed9cb132f7" released by "delete_snapshot" :: held 1.696s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Created reservations ['f1dc7a04-82b3-46c1-95e2-9b53f388825d', '379e19e1-04a0-41cf-b984-6477b8a925a0', '33294be0-a33a-477c-9b45-6c92827ed579', '17fc4c33-fb4f-4b9f-bae8-247e41d890f6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:29 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Delete snapshot completed successfully.
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9e48261f-0c4b-43e2-8529-346cf06ffa0b tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-a63f21fd-c111-41b8-a6e1-3ffde5c328fa-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Flow 'volume_create_manager' (814d81b4-b437-4bb5-a2dd-dc2cb8fbb91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25833c5-0399-4f2e-bd2e-5b80f197f6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25833c5-0399-4f2e-bd2e-5b80f197f6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-504533270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4dfcb7f5704f548ad3534c1daf4ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:30Z,use_quota=True,user_id='305dd5b3cec84a6198f0f4de169048c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9ce3af1-1740-4bee-a3ba-3e684db128e2),volume_type_id=a9ce3af1-1740-4bee-a3ba-3e684db128e2)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70df500d-8a6a-47cd-90fe-c8c0dd90607a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70df500d-8a6a-47cd-90fe-c8c0dd90607a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f78e47-2a0d-44c6-abf8-6020ec43b671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f78e47-2a0d-44c6-abf8-6020ec43b671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c', 'volume_name': 'volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea48932-8f4a-4ade-97f8-9b4ddef2b3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea48932-8f4a-4ade-97f8-9b4ddef2b3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ad39d1-74bd-4687-85b6-8a691794f529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:29 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Volume 9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c', 'volume_size': 1}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-504533270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4dfcb7f5704f548ad3534c1daf4ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:30Z,use_quota=True,user_id='305dd5b3cec84a6198f0f4de169048c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9ce3af1-1740-4bee-a3ba-3e684db128e2),volume_type_id=a9ce3af1-1740-4bee-a3ba-3e684db128e2)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Creating volume 9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:29:30 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:30 devstack sudo[102591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c 1073741824
Aug 04 09:29:30 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-55e5dc50-097d-4907-b912-c0ed9cb132f7-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-55e5dc50-097d-4907-b912-c0ed9cb132f7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:29:30 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Flow 'volume_create_manager' (f058c817-173a-4328-ab02-93bb6ce722f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73616492-4e7e-4fb6-bb98-730b976654b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c 1073741824" returned: 0 in 0.688s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Flow 'volume_create_manager' (1e0ec076-c30e-4ef2-afaf-4a7ae7b23850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fb7128-a4fa-4d49-8d79-2e1f0bd174d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73616492-4e7e-4fb6-bb98-730b976654b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1412935399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f128550d-9f31-4980-a2e5-c3fe51528019,host='devstack@QuobyteHD#QuobyteHD',id=05565472-f307-468a-912a-a139f9e32846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbe081da9414ff59abc0dc8cbd671dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:31Z,use_quota=True,user_id='ec1bc29efeb6488ea1abdf69e5e3076f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddb53b15-6330-4bb2-959b-15b78f44c61d),volume_type_id=ddb53b15-6330-4bb2-959b-15b78f44c61d)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56cf68b2-031e-4c68-a6e6-8740b43aacde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56cf68b2-031e-4c68-a6e6-8740b43aacde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad66388c-3797-45b4-884b-f539c3d1ed3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad66388c-3797-45b4-884b-f539c3d1ed3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05565472-f307-468a-912a-a139f9e32846', 'volume_name': 'volume-05565472-f307-468a-912a-a139f9e32846', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d6b386-3c55-4fa3-ae71-c81c619c010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d6b386-3c55-4fa3-ae71-c81c619c010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df97a516-86b2-4224-9b62-0dc63fe13a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Volume 05565472-f307-468a-912a-a139f9e32846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05565472-f307-468a-912a-a139f9e32846', 'volume_size': 1}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fb7128-a4fa-4d49-8d79-2e1f0bd174d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1535943119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9a81b0-80c8-406b-a767-e05a2b454643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4dfcb7f5704f548ad3534c1daf4ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:31Z,use_quota=True,user_id='305dd5b3cec84a6198f0f4de169048c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b0abdab-18fa-4385-8ab1-fb937a1184f2),volume_type_id=6b0abdab-18fa-4385-8ab1-fb937a1184f2)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4be228-b897-4698-811e-eec0f20038bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4be228-b897-4698-811e-eec0f20038bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819a6472-c8f7-4d01-944c-adab62d3b783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819a6472-c8f7-4d01-944c-adab62d3b783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb9a81b0-80c8-406b-a767-e05a2b454643', 'volume_name': 'volume-bb9a81b0-80c8-406b-a767-e05a2b454643', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c683a95-cbd8-4754-a2a0-e6c558d672d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c683a95-cbd8-4754-a2a0-e6c558d672d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce404883-3883-4573-8c63-0772e97be969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Volume bb9a81b0-80c8-406b-a767-e05a2b454643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb9a81b0-80c8-406b-a767-e05a2b454643', 'volume_size': 1}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-55e5dc50-097d-4907-b912-c0ed9cb132f7" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-55e5dc50-097d-4907-b912-c0ed9cb132f7" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[be91d82a-ca3d-4401-a2f7-8769ff4f34a1]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:30 devstack sudo[102599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c
Aug 04 09:29:30 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:31 devstack sudo[102600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7
Aug 04 09:29:31 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:31 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c" returned: 0 in 0.286s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f128550d-9f31-4980-a2e5-c3fe51528019,created_at=2026-08-04T07:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1412935399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f128550d-9f31-4980-a2e5-c3fe51528019,host='devstack@QuobyteHD#QuobyteHD',id=05565472-f307-468a-912a-a139f9e32846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbe081da9414ff59abc0dc8cbd671dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:31Z,use_quota=True,user_id='ec1bc29efeb6488ea1abdf69e5e3076f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddb53b15-6330-4bb2-959b-15b78f44c61d),volume_type_id=ddb53b15-6330-4bb2-959b-15b78f44c61d)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Creating volume 05565472-f307-468a-912a-a139f9e32846 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:29:31 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:31 devstack sudo[102604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846 1073741824
Aug 04 09:29:31 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ad39d1-74bd-4687-85b6-8a691794f529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e87686c-be0c-4b9e-b2c9-cc62f4bf6c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:31 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Volume volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c (9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c): created successfully
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e87686c-be0c-4b9e-b2c9-cc62f4bf6c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Flow 'volume_create_manager' (814d81b4-b437-4bb5-a2dd-dc2cb8fbb91d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:29:31 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Flow 'volume_create_manager' (453e2dbd-3600-48ea-94e1-cc149d219247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3fa6c7-8abb-4659-85fd-2c346a1c4033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7" returned: 0 in 0.399s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:31 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-31686d7c-bb3e-4dbf-bcb0-593782e26582 tempest-TestInstancesWithCinderVolumes-268566882 None] Created volume successfully.
Aug 04 09:29:31 devstack sudo[102609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7
Aug 04 09:29:31 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3fa6c7-8abb-4659-85fd-2c346a1c4033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-363983995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19b6e2b-83a0-43df-9684-8e03ee24dc85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4dfcb7f5704f548ad3534c1daf4ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:31Z,use_quota=True,user_id='305dd5b3cec84a6198f0f4de169048c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d95a9d6-72c0-4f0f-9518-73b890fb404d),volume_type_id=4d95a9d6-72c0-4f0f-9518-73b890fb404d)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec77a4c-6408-49ab-8fee-9376afb4367f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec77a4c-6408-49ab-8fee-9376afb4367f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73a174e-897d-4cba-b518-b3d8315c8553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.image.glance [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Creating Keystone auth plugin from conf {{(pid=88880) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 04 09:29:31 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-55e5dc50-097d-4907-b912-c0ed9cb132f7" returned: 0 in 0.279s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-55e5dc50-097d-4907-b912-c0ed9cb132f7" released by "delete_volume" :: held 0.750s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73a174e-897d-4cba-b518-b3d8315c8553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c19b6e2b-83a0-43df-9684-8e03ee24dc85', 'volume_name': 'volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85', 'volume_size': 1, 'image_id': '2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1382159378', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4f4dfcb7f5704f548ad3534c1daf4ecf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'created_at': datetime.datetime(2026, 8, 4, 7, 29, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 29, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c8f450a-90b4-40a6-aff9-b9ca077f959d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba5a5250>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e51ab4-1968-4181-97b5-dfd0a0e7cc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e51ab4-1968-4181-97b5-dfd0a0e7cc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2e132c-d3b9-4461-ad5a-d023be2629d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:31 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Volume c19b6e2b-83a0-43df-9684-8e03ee24dc85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85', 'volume_size': 1, 'image_id': '2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1382159378', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4f4dfcb7f5704f548ad3534c1daf4ecf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'created_at': datetime.datetime(2026, 8, 4, 7, 29, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 29, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c8f450a-90b4-40a6-aff9-b9ca077f959d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba5a5250>}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Trying to clone c19b6e2b-83a0-43df-9684-8e03ee24dc85 from image 2c8f450a-90b4-40a6-aff9-b9ca077f959d at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'metadata': {}}]). {{(pid=88880) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Created reservations ['6d99108a-8bdf-4207-96f3-dd1c767f7f4c', '0884dc65-aa7a-400d-826d-c0aa89269311', '639d53f6-0447-4366-a04e-82cd9ec9e717', '95237018-f198-41c1-a5c0-75d9ec076435'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:31 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846 1073741824" returned: 0 in 0.523s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:31 devstack sudo[102616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846
Aug 04 09:29:31 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:31 devstack sudo[102618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:29:31 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:32 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846" returned: 0 in 0.276s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.224s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1535943119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9a81b0-80c8-406b-a767-e05a2b454643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4dfcb7f5704f548ad3534c1daf4ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:31Z,use_quota=True,user_id='305dd5b3cec84a6198f0f4de169048c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b0abdab-18fa-4385-8ab1-fb937a1184f2),volume_type_id=6b0abdab-18fa-4385-8ab1-fb937a1184f2)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Creating volume bb9a81b0-80c8-406b-a767-e05a2b454643 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:29:32 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:32 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.271s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:29:32 devstack sudo[102622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643 1073741824
Aug 04 09:29:32 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df97a516-86b2-4224-9b62-0dc63fe13a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05565472-f307-468a-912a-a139f9e32846', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c6b79d-7adf-4479-96d8-0a526f7f58b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:32 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Deleted volume successfully.
Aug 04 09:29:32 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Volume volume-05565472-f307-468a-912a-a139f9e32846 (05565472-f307-468a-912a-a139f9e32846): created successfully
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c6b79d-7adf-4479-96d8-0a526f7f58b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Flow 'volume_create_manager' (f058c817-173a-4328-ab02-93bb6ce722f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:32 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-8c15fe02-b1ba-48a4-a670-cb155b5a566f tempest-GroupSnapshotsV319Test-1929595041 None] Created volume successfully.
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-05dd5f3d-7d70-4d79-93e4-94638eb82c89 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-55e5dc50-097d-4907-b912-c0ed9cb132f7-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:32 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643 1073741824" returned: 0 in 0.439s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:32 devstack sudo[102627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643
Aug 04 09:29:32 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:32 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643" returned: 0 in 0.328s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce404883-3883-4573-8c63-0772e97be969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9a81b0-80c8-406b-a767-e05a2b454643', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecbee79-c01a-4dcf-900b-7268ef9d478f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:32 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Volume volume-bb9a81b0-80c8-406b-a767-e05a2b454643 (bb9a81b0-80c8-406b-a767-e05a2b454643): created successfully
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecbee79-c01a-4dcf-900b-7268ef9d478f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Flow 'volume_create_manager' (1e0ec076-c30e-4ef2-afaf-4a7ae7b23850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:33 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-74b01169-92fd-443a-ab46-2ee477cb8e82 tempest-TestInstancesWithCinderVolumes-268566882 None] Created volume successfully.
Aug 04 09:29:33 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] GroupSnapshot 9773e5b8-6911-40d5-98d5-7112c97e3949: creating.
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] Group snapshot 9773e5b8-6911-40d5-98d5-7112c97e3949: creating. {{(pid=88880) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] Creating offline snapshot bcccf92f-83d2-4bb6-b2b6-57cea1e6e859 of volume 05565472-f307-468a-912a-a139f9e32846 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b2ab18-3c85-416f-b56c-b8b11e6c3ac3]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:33 devstack sudo[102630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846
Aug 04 09:29:33 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Flow 'volume_create_manager' (8580c6dc-bd11-461e-bca5-3c185fe6fc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc37c45-6db8-42b0-b857-a0bb4cf17d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc37c45-6db8-42b0-b857-a0bb4cf17d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1882816497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94507acf-fc14-4d0b-8694-82b87dbe8e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ac4b910a05412cb0970fc5a43aedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:33Z,use_quota=True,user_id='d85ff6513d7f40a3af128c3e8e988f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7876394e-2c77-4ad1-84ef-73688d359bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7876394e-2c77-4ad1-84ef-73688d359bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfcd648-1f15-4cda-a264-c9797ec50545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfcd648-1f15-4cda-a264-c9797ec50545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94507acf-fc14-4d0b-8694-82b87dbe8e3e', 'volume_name': 'volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b7cd7d-c635-4cbd-b80f-3801702b7a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b7cd7d-c635-4cbd-b80f-3801702b7a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee33edc-6a41-46a6-8d1f-e18e596baee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:33 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Volume 94507acf-fc14-4d0b-8694-82b87dbe8e3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e', 'volume_size': 1}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:33 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846" returned: 0 in 0.381s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:33 devstack sudo[102635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859 1G
Aug 04 09:29:33 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:33 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859 1G" returned: 0 in 0.395s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05565472-f307-468a-912a-a139f9e32846 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:33 devstack sudo[102640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05565472-f307-468a-912a-a139f9e32846 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859
Aug 04 09:29:33 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:34 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05565472-f307-468a-912a-a139f9e32846 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859" returned: 0 in 0.309s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:34 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859 is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:29:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:34 devstack sudo[102645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859
Aug 04 09:29:34 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:34 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859" returned: 0 in 0.233s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:34 devstack sudo[102648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.info
Aug 04 09:29:34 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:34 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.info" returned: 0 in 0.263s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:34 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:29:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:34 devstack sudo[102651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.info
Aug 04 09:29:34 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:34 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.info" returned: 0 in 0.237s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.560s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1882816497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94507acf-fc14-4d0b-8694-82b87dbe8e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ac4b910a05412cb0970fc5a43aedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:33Z,use_quota=True,user_id='d85ff6513d7f40a3af128c3e8e988f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Creating volume 94507acf-fc14-4d0b-8694-82b87dbe8e3e {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:29:35 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:35 devstack sudo[102654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e 1073741824
Aug 04 09:29:35 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:35 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-5bcd8746-c584-4e43-8de7-4f7c604a87e4 tempest-GroupSnapshotsV319Test-1929595041 None] group_snapshot 9773e5b8-6911-40d5-98d5-7112c97e3949: created successfully
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD, size 20.69 MB, duration 3.74 sec {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 04 09:29:35 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Image download 20.69 MB at 5.53 MB/s
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[65175826-2fc3-407e-9cd6-6700a99ed597]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:35 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e 1073741824" returned: 0 in 0.515s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:35 devstack sudo[102661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e
Aug 04 09:29:35 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:35 devstack sudo[102660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD
Aug 04 09:29:35 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:35 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] group_snapshot 9773e5b8-6911-40d5-98d5-7112c97e3949: deleting
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] group_snapshot 9773e5b8-6911-40d5-98d5-7112c97e3949: deleting {{(pid=88880) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Acquiring lock "cinder-quobyte-05565472-f307-468a-912a-a139f9e32846" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Lock "cinder-quobyte-05565472-f307-468a-912a-a139f9e32846" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Acquiring lock "cinder-quobyte-bcccf92f-83d2-4bb6-b2b6-57cea1e6e859" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Lock "cinder-quobyte-bcccf92f-83d2-4bb6-b2b6-57cea1e6e859" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Deleting offline snapshot bcccf92f-83d2-4bb6-b2b6-57cea1e6e859 of volume 05565472-f307-468a-912a-a139f9e32846 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] snapshot_file for this snap is: volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc043a97-b69a-46bc-b8d3-259b3c82266f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:35 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e" returned: 0 in 0.317s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:35 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Temporary image 2c8f450a-90b4-40a6-aff9-b9ca077f959d is fetched for user 305dd5b3cec84a6198f0f4de169048c9. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee33edc-6a41-46a6-8d1f-e18e596baee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2752b66b-ae81-4a91-8a4b-9481c85f123a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:35 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Volume volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e (94507acf-fc14-4d0b-8694-82b87dbe8e3e): created successfully
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2752b66b-ae81-4a91-8a4b-9481c85f123a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Flow 'volume_create_manager' (8580c6dc-bd11-461e-bca5-3c185fe6fc09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:35 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-572a6749-78c3-4c2c-80b4-2486597ccaaf tempest-VolumesSnapshotTestJSON-503509665 None] Created volume successfully.
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f85daf3-9770-45fc-b2dd-6ab28c7214fe]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:36 devstack sudo[102668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859
Aug 04 09:29:36 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:36 devstack sudo[102670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD
Aug 04 09:29:36 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:36 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859" returned: 0 in 0.426s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05565472-f307-468a-912a-a139f9e32846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eb02b9-daac-4ad8-87ae-c0dcb5ddd486]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:36 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-363983995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19b6e2b-83a0-43df-9684-8e03ee24dc85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4dfcb7f5704f548ad3534c1daf4ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:31Z,use_quota=True,user_id='305dd5b3cec84a6198f0f4de169048c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d95a9d6-72c0-4f0f-9518-73b890fb404d),volume_type_id=4d95a9d6-72c0-4f0f-9518-73b890fb404d)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Creating volume c19b6e2b-83a0-43df-9684-8e03ee24dc85 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:29:36 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:36 devstack sudo[102675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846
Aug 04 09:29:36 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:36 devstack sudo[102679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 1073741824
Aug 04 09:29:36 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:36 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846" returned: 0 in 0.478s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:36 devstack sudo[102688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859
Aug 04 09:29:36 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:36 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 1073741824" returned: 0 in 0.526s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:37 devstack sudo[102690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85
Aug 04 09:29:37 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:37 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859" returned: 0 in 0.367s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:37 devstack sudo[102695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859
Aug 04 09:29:37 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:37 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85" returned: 0 in 0.273s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.502s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] Creating offline snapshot 242cd411-b4aa-494d-8ddc-a00874914a89 of volume 94507acf-fc14-4d0b-8694-82b87dbe8e3e {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a92ca1-82dd-4c55-a3ca-3e0978de82cd]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Attempting download of 2c8f450a-90b4-40a6-aff9-b9ca077f959d ((None, [{'url': 'file:///opt/stack/data/glance/images/2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'metadata': {}}])) to volume c19b6e2b-83a0-43df-9684-8e03ee24dc85. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[03be43d4-d528-4ebe-b647-b6cfdf2973ee]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c8f450a-90b4-40a6-aff9-b9ca077f959d_f5dgwas8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:37 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846.bcccf92f-83d2-4bb6-b2b6-57cea1e6e859" returned: 0 in 0.287s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Lock "cinder-quobyte-bcccf92f-83d2-4bb6-b2b6-57cea1e6e859" released by "_delete_snapshot" :: held 1.669s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Lock "cinder-quobyte-05565472-f307-468a-912a-a139f9e32846" released by "delete_snapshot" :: held 1.695s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:37 devstack sudo[102698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e
Aug 04 09:29:37 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:37 devstack sudo[102700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c8f450a-90b4-40a6-aff9-b9ca077f959d_f5dgwas8
Aug 04 09:29:37 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:37 devstack cinder-volume[88880]: WARNING cinder.quota [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1526367619 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1526367619, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:29:37 devstack cinder-volume[88880]: WARNING cinder.quota [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1526367619 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1526367619, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] Created reservations ['2177771d-36f6-4d4d-b9ea-32aea386b97b', 'efe2460e-3180-4242-be74-e3f5c8b29d78', '725be276-8196-498f-a74e-4af7fdf3225a', '38689e3c-2eef-4e8e-8dc9-3f21f2e17599'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a49e2829-b36e-4048-9311-9037bf44d15d tempest-GroupSnapshotsV319Test-1929595041 None] group_snapshot 9773e5b8-6911-40d5-98d5-7112c97e3949: deleted successfully
Aug 04 09:29:37 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e" returned: 0 in 0.441s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:37 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c8f450a-90b4-40a6-aff9-b9ca077f959d_f5dgwas8" returned: 0 in 0.373s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c8f450a-90b4-40a6-aff9-b9ca077f959d_f5dgwas8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:37 devstack sudo[102708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89 1G
Aug 04 09:29:37 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:37 devstack sudo[102710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c8f450a-90b4-40a6-aff9-b9ca077f959d_f5dgwas8
Aug 04 09:29:37 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:38 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c8f450a-90b4-40a6-aff9-b9ca077f959d_f5dgwas8" returned: 1 in 0.335s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c8f450a-90b4-40a6-aff9-b9ca077f959d_f5dgwas8' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4702258f-1eed-4d0b-a074-58cae01ef7cd]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:38 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89 1G" returned: 0 in 0.445s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:38 devstack sudo[102718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89
Aug 04 09:29:38 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:38 devstack sudo[102717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD
Aug 04 09:29:38 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Acquiring lock "cinder-quobyte-05565472-f307-468a-912a-a139f9e32846" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Lock "cinder-quobyte-05565472-f307-468a-912a-a139f9e32846" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0ef43a-5088-4750-858f-0742daeeb290]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:38 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] 2c8f450a-90b4-40a6-aff9-b9ca077f959d was qcow2, converting to raw {{(pid=88880) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:38 devstack sudo[102728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85
Aug 04 09:29:38 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:38 devstack sudo[102721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846
Aug 04 09:29:38 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:38 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89" returned: 0 in 0.332s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:38 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89 is being set with open permissions: ugo+rw
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:38 devstack sudo[102731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89
Aug 04 09:29:38 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:38 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846" returned: 0 in 0.384s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:38 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89" returned: 0 in 0.249s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:38 devstack sudo[102740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846
Aug 04 09:29:38 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:38 devstack sudo[102750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.info
Aug 04 09:29:38 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:39 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-05565472-f307-468a-912a-a139f9e32846" returned: 0 in 0.302s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Lock "cinder-quobyte-05565472-f307-468a-912a-a139f9e32846" released by "delete_volume" :: held 0.748s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:39 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.info" returned: 0 in 0.308s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:39 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.info is being set with open permissions: ugo+rw
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:39 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.info
Aug 04 09:29:39 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Created reservations ['18b4b249-339b-4511-a813-a17e59b488f6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:39 devstack cinder-volume[88880]: WARNING cinder.quota [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1526367619 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1526367619, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Created reservations ['7b7ce2ba-2c31-4886-b6f9-bf0874e48364', '7f7051d4-14f7-46ca-ad38-eea48a4051e3', 'bbbc1240-99a3-477e-856a-0c1f3d89eb6e', '51da7406-4c9e-4172-8af5-718cd1d83018'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:39 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.info" returned: 0 in 0.295s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:39 devstack sudo[102757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:29:39 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:39 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1ab769f9-8f02-4df1-8ec9-5bb760a09b5a tempest-VolumesSnapshotTestJSON-503509665 None] Create snapshot completed successfully
Aug 04 09:29:39 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.283s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:39 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:29:39 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d92f0941-70ad-4053-b23d-0ee89685a191 tempest-GroupSnapshotsV319Test-1929595041 None] Delete group completed successfully.
Aug 04 09:29:40 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85" returned: 0 in 1.934s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c8f450a-90b4-40a6-aff9-b9ca077f959d_nf0lbfhudevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:29:40 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Converted 112.00 MB image at 57.89 MB/s
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:40 devstack sudo[102761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 1G
Aug 04 09:29:40 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Flow 'volume_create_manager' (3c339b06-0211-4d0e-84e3-88d59ea4fcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2d65f7-368f-4c13-b6d8-122f8d6e5c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2d65f7-368f-4c13-b6d8-122f8d6e5c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-444856896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a06fc4-0db5-4ef2-afa1-6d5db2b67683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ac4b910a05412cb0970fc5a43aedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=242cd411-b4aa-494d-8ddc-a00874914a89,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:41Z,use_quota=True,user_id='d85ff6513d7f40a3af128c3e8e988f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64348ee4-1b89-4230-a5ee-120d9f1036ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64348ee4-1b89-4230-a5ee-120d9f1036ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fec286-bfe8-4bd8-b31e-60eacda6e282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fec286-bfe8-4bd8-b31e-60eacda6e282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16a06fc4-0db5-4ef2-afa1-6d5db2b67683', 'volume_name': 'volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683', 'volume_size': 1, 'snapshot_id': '242cd411-b4aa-494d-8ddc-a00874914a89'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4ce5ab-889f-4449-b072-24d2027688c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4ce5ab-889f-4449-b072-24d2027688c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795c1bfd-c04e-4e28-a89e-9ed995877742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:40 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Volume 16a06fc4-0db5-4ef2-afa1-6d5db2b67683: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683', 'volume_size': 1, 'snapshot_id': '242cd411-b4aa-494d-8ddc-a00874914a89'}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-242cd411-b4aa-494d-8ddc-a00874914a89-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" by "_create_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-242cd411-b4aa-494d-8ddc-a00874914a89-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Creating volume 16a06fc4-0db5-4ef2-afa1-6d5db2b67683 from snapshot 242cd411-b4aa-494d-8ddc-a00874914a89 {{(pid=88880) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:40 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" by "_copy_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 1G" returned: 0 in 0.351s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] snapshot: 242cd411-b4aa-494d-8ddc-a00874914a89, volume: 16a06fc4-0db5-4ef2-afa1-6d5db2b67683,  {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4772fac4-cec3-495c-8d71-ffd9546090a3]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cd25fa-a25b-4c65-853b-852169000fee]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:41 devstack sudo[102766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85
Aug 04 09:29:41 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:41 devstack sudo[102767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89
Aug 04 09:29:41 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:41 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85" returned: 0 in 0.402s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:41 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89" returned: 0 in 0.440s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Creating direct copy from snapshot {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[91903bf3-4b99-4e4b-8cd1-5af7421ac5f3]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:41 devstack sudo[102789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85
Aug 04 09:29:41 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:41 devstack sudo[102810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e
Aug 04 09:29:41 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:41 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85" returned: 1 in 0.461s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Downloaded image 2c8f450a-90b4-40a6-aff9-b9ca077f959d ((None, [{'url': 'file:///opt/stack/data/glance/images/2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'metadata': {}}])) to volume c19b6e2b-83a0-43df-9684-8e03ee24dc85 successfully. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Temporary image 2c8f450a-90b4-40a6-aff9-b9ca077f959d for user 305dd5b3cec84a6198f0f4de169048c9 is deleted. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Marking volume c19b6e2b-83a0-43df-9684-8e03ee24dc85 as bootable. {{(pid=88880) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Copying metadata from image 2c8f450a-90b4-40a6-aff9-b9ca077f959d to c19b6e2b-83a0-43df-9684-8e03ee24dc85. {{(pid=88880) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Creating volume glance metadata for volume c19b6e2b-83a0-43df-9684-8e03ee24dc85 backed by image 2c8f450a-90b4-40a6-aff9-b9ca077f959d with: {'image_id': '2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'image_name': 'tempest-scenario-img--1382159378', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88880) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2e132c-d3b9-4461-ad5a-d023be2629d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85', 'volume_size': 1, 'image_id': '2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1382159378', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4f4dfcb7f5704f548ad3534c1daf4ecf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c8f450a-90b4-40a6-aff9-b9ca077f959d', 'created_at': datetime.datetime(2026, 8, 4, 7, 29, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 29, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c8f450a-90b4-40a6-aff9-b9ca077f959d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba5a5250>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697fe6a1-a089-438c-b1ae-8dfd82cf95ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:41 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Volume volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 (c19b6e2b-83a0-43df-9684-8e03ee24dc85): created successfully
Aug 04 09:29:41 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697fe6a1-a089-438c-b1ae-8dfd82cf95ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Flow 'volume_create_manager' (453e2dbd-3600-48ea-94e1-cc149d219247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e" returned: 0 in 0.558s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG cinder.utils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Path /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683 not found in is_blk_device check {{(pid=88880) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 04 09:29:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:41 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-37d66c6f-90a5-42d0-8c25-0ccc1eff4eb4 tempest-TestInstancesWithCinderVolumes-268566882 None] Created volume successfully.
Aug 04 09:29:41 devstack sudo[102821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683
Aug 04 09:29:41 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:46 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" returned: 0 in 4.933s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:46 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd21977a-cd76-4696-9d2f-6041c804dd01]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:46 devstack sudo[102838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e
Aug 04 09:29:46 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:47 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e" returned: 0 in 0.597s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:47 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:29:47 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Converted 1024.00 MB image at 207.53 MB/s
Aug 04 09:29:47 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683 is being set with open permissions: ugo+rw
Aug 04 09:29:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:47 devstack sudo[102843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683
Aug 04 09:29:47 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:47 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" returned: 0 in 0.279s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" released by "_copy_volume_from_snapshot" :: held 6.933s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-242cd411-b4aa-494d-8ddc-a00874914a89-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" released by "_create_volume_from_snapshot" :: held 6.976s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.995s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795c1bfd-c04e-4e28-a89e-9ed995877742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683', 'volume_size': 1, 'snapshot_id': '242cd411-b4aa-494d-8ddc-a00874914a89'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72019862-8a4c-49a8-a8a7-bb59a88c54fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:47 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Volume volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683 (16a06fc4-0db5-4ef2-afa1-6d5db2b67683): created successfully
Aug 04 09:29:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72019862-8a4c-49a8-a8a7-bb59a88c54fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Flow 'volume_create_manager' (3c339b06-0211-4d0e-84e3-88d59ea4fcfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:47 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b97b46e4-65be-4584-ac9c-eaa60b7b5a11 tempest-VolumesSnapshotTestJSON-503509665 None] Created volume successfully.
Aug 04 09:29:48 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-05ebda8d-7aeb-4ddc-9726-e40c052eee93 tempest-GroupsV314Test-690529561 None] Group tempest-GroupsV314Test-Group-2144969407: creating
Aug 04 09:29:48 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-05ebda8d-7aeb-4ddc-9726-e40c052eee93 tempest-GroupsV314Test-690529561 None] Group tempest-GroupsV314Test-Group-2144969407: created successfully
Aug 04 09:29:48 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-05ebda8d-7aeb-4ddc-9726-e40c052eee93 tempest-GroupsV314Test-690529561 None] Create group completed successfully.
Aug 04 09:29:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-add31037-e5b0-44b6-8bf5-072a7c0b8bbf req-cb41382a-52fc-41f3-ae2b-e54ebca96ca4 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-add31037-e5b0-44b6-8bf5-072a7c0b8bbf req-cb41382a-52fc-41f3-ae2b-e54ebca96ca4 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:48 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b7756c-0e5b-4d08-aea6-8e1e46d936f2]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-add31037-e5b0-44b6-8bf5-072a7c0b8bbf req-cb41382a-52fc-41f3-ae2b-e54ebca96ca4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-16a06fc4-0db5-4ef2-afa1-6d5db2b67683-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-16a06fc4-0db5-4ef2-afa1-6d5db2b67683-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:48 devstack sudo[102854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85
Aug 04 09:29:48 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" acquired by "delete_volume" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:48 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b5c5e3-4e36-4ce7-af45-4e2689b03fab]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:48 devstack sudo[102856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683
Aug 04 09:29:48 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:48 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-add31037-e5b0-44b6-8bf5-072a7c0b8bbf req-cb41382a-52fc-41f3-ae2b-e54ebca96ca4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85" returned: 0 in 0.490s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-add31037-e5b0-44b6-8bf5-072a7c0b8bbf req-cb41382a-52fc-41f3-ae2b-e54ebca96ca4 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:49 devstack sudo[102860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85
Aug 04 09:29:49 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:49 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" returned: 0 in 0.466s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:49 devstack sudo[102865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683
Aug 04 09:29:49 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:49 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-add31037-e5b0-44b6-8bf5-072a7c0b8bbf req-cb41382a-52fc-41f3-ae2b-e54ebca96ca4 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85" returned: 1 in 0.458s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-add31037-e5b0-44b6-8bf5-072a7c0b8bbf req-cb41382a-52fc-41f3-ae2b-e54ebca96ca4 tempest-TestInstancesWithCinderVolumes-268566882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-add31037-e5b0-44b6-8bf5-072a7c0b8bbf req-cb41382a-52fc-41f3-ae2b-e54ebca96ca4 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.992s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:49 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" returned: 0 in 0.308s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-16a06fc4-0db5-4ef2-afa1-6d5db2b67683" released by "delete_volume" :: held 0.822s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-add31037-e5b0-44b6-8bf5-072a7c0b8bbf req-cb41382a-52fc-41f3-ae2b-e54ebca96ca4 tempest-TestInstancesWithCinderVolumes-268566882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af65ba6f-e9da-4411-bd57-7770294fe554', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Created reservations ['6d119b08-3b4e-48f3-a819-544ab67f2181', 'cae1bc59-9780-4892-abd8-1cbcf815804e', 'fc03afee-8d83-4f7a-b767-236425de5917', '1abfb68a-5765-48ce-9fd6-62df3f4baa30'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:49 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-add31037-e5b0-44b6-8bf5-072a7c0b8bbf req-cb41382a-52fc-41f3-ae2b-e54ebca96ca4 tempest-TestInstancesWithCinderVolumes-268566882 None] attachment_update completed successfully.
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:49 devstack sudo[102872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:29:49 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:50 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-242cd411-b4aa-494d-8ddc-a00874914a89-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.397s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:29:50 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Deleted volume successfully.
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-242cd411-b4aa-494d-8ddc-a00874914a89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-94507acf-fc14-4d0b-8694-82b87dbe8e3e" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3e5f38b3-53b5-4e07-9442-b0907526728d tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-16a06fc4-0db5-4ef2-afa1-6d5db2b67683-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-94507acf-fc14-4d0b-8694-82b87dbe8e3e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-242cd411-b4aa-494d-8ddc-a00874914a89" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-242cd411-b4aa-494d-8ddc-a00874914a89" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Deleting offline snapshot 242cd411-b4aa-494d-8ddc-a00874914a89 of volume 94507acf-fc14-4d0b-8694-82b87dbe8e3e {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] snapshot_file for this snap is: volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[861bcb42-b65c-4c10-95b8-4ab11874fe5e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Flow 'volume_create_manager' (4ad6a2cd-26d4-470d-8190-6fe7c13e5f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7887fd27-aebd-4e63-8911-ebb4f4f5f180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7887fd27-aebd-4e63-8911-ebb4f4f5f180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1670394603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5ce1a7e9-797a-4db7-91dc-fd016dc953c2,host='devstack@QuobyteHD#QuobyteHD',id=9333cf60-eef9-4630-8e37-5e1d41539652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f78b9586452f4d55ba046180d0aac069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:50Z,use_quota=True,user_id='4f5023e9135947de985c32e2029a8c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b783355-1786-4db7-88c3-799a52b5941c),volume_type_id=2b783355-1786-4db7-88c3-799a52b5941c)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571f0575-b0de-4de8-9271-564e5233822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571f0575-b0de-4de8-9271-564e5233822a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56922990-bad1-47bd-b314-05bfef72678f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56922990-bad1-47bd-b314-05bfef72678f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9333cf60-eef9-4630-8e37-5e1d41539652', 'volume_name': 'volume-9333cf60-eef9-4630-8e37-5e1d41539652', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958ad07c-4472-4adb-b85a-dd04d27e5e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958ad07c-4472-4adb-b85a-dd04d27e5e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:50 devstack sudo[102875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89
Aug 04 09:29:50 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c37bfb2-3f74-4e0d-a66d-4c5f04226f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:50 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Volume 9333cf60-eef9-4630-8e37-5e1d41539652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9333cf60-eef9-4630-8e37-5e1d41539652', 'volume_size': 1}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5ce1a7e9-797a-4db7-91dc-fd016dc953c2,created_at=2026-08-04T07:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1670394603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5ce1a7e9-797a-4db7-91dc-fd016dc953c2,host='devstack@QuobyteHD#QuobyteHD',id=9333cf60-eef9-4630-8e37-5e1d41539652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f78b9586452f4d55ba046180d0aac069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:29:50Z,use_quota=True,user_id='4f5023e9135947de985c32e2029a8c43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b783355-1786-4db7-88c3-799a52b5941c),volume_type_id=2b783355-1786-4db7-88c3-799a52b5941c)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Creating volume 9333cf60-eef9-4630-8e37-5e1d41539652 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:29:50 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:50 devstack sudo[102877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 1073741824
Aug 04 09:29:50 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:50 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89" returned: 0 in 0.547s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[277b2db3-c18b-4a78-ac6d-0d06e3f893df]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:50 devstack sudo[102886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e
Aug 04 09:29:50 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:50 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 1073741824" returned: 0 in 0.597s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:51 devstack sudo[102889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652
Aug 04 09:29:51 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:51 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e" returned: 0 in 0.429s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:51 devstack sudo[102916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89
Aug 04 09:29:51 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:51 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652" returned: 0 in 0.374s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c37bfb2-3f74-4e0d-a66d-4c5f04226f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9333cf60-eef9-4630-8e37-5e1d41539652', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0189644a-a3d7-46d1-bf60-878b6e2cee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:29:51 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Volume volume-9333cf60-eef9-4630-8e37-5e1d41539652 (9333cf60-eef9-4630-8e37-5e1d41539652): created successfully
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0189644a-a3d7-46d1-bf60-878b6e2cee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Flow 'volume_create_manager' (4ad6a2cd-26d4-470d-8190-6fe7c13e5f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:29:51 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3603d181-9c3e-4f8d-8f9c-9cc223285b4a tempest-GroupsV314Test-690529561 None] Created volume successfully.
Aug 04 09:29:51 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89" returned: 0 in 0.663s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:51 devstack sudo[103314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89
Aug 04 09:29:51 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:52 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e.242cd411-b4aa-494d-8ddc-a00874914a89" returned: 0 in 0.326s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-242cd411-b4aa-494d-8ddc-a00874914a89" released by "_delete_snapshot" :: held 2.134s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-94507acf-fc14-4d0b-8694-82b87dbe8e3e" released by "delete_snapshot" :: held 2.175s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:52 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Created reservations ['db9928e4-1b54-4195-8a27-ba100e4dbb56', '49dbdea1-2e46-452b-9af9-51877762b8fd', '1ec3002f-63c6-4037-a8f4-6cedb69bb6fc', '8538af34-63cb-4eda-95a2-a09c29013802'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:52 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Delete snapshot completed successfully.
Aug 04 09:29:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f03abe53-dd88-4f6d-9d6a-99cc766f65ab tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-242cd411-b4aa-494d-8ddc-a00874914a89-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:53 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Cloning volume 9333cf60-eef9-4630-8e37-5e1d41539652 to volume 9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-94507acf-fc14-4d0b-8694-82b87dbe8e3e-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Creating offline snapshot ed6862a1-c689-4bf8-b66e-40dbfffddcb1 of volume 9333cf60-eef9-4630-8e37-5e1d41539652 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-94507acf-fc14-4d0b-8694-82b87dbe8e3e-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d390b184-d401-4060-8655-6e2875c01de0]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-94507acf-fc14-4d0b-8694-82b87dbe8e3e" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-94507acf-fc14-4d0b-8694-82b87dbe8e3e" acquired by "delete_volume" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:53 devstack sudo[103367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652
Aug 04 09:29:53 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2384395-b1e9-403c-a958-acb5d829e0ee]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:53 devstack sudo[103369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e
Aug 04 09:29:53 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:53 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652" returned: 0 in 0.475s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:54 devstack sudo[103377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1 1G
Aug 04 09:29:54 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:54 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e" returned: 0 in 0.382s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:54 devstack sudo[103379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e
Aug 04 09:29:54 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:54 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-94507acf-fc14-4d0b-8694-82b87dbe8e3e" returned: 0 in 0.290s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-94507acf-fc14-4d0b-8694-82b87dbe8e3e" released by "delete_volume" :: held 0.766s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Created reservations ['66dc9dd1-ca49-4af4-a689-26c77fe06cac', '0fdd2897-4400-43ba-af87-a630739f2eae', '9b0fc0d7-ade1-4563-bc24-68e3f696b89a', '74de09b0-99af-4a07-aed8-0c5e3a72c092'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:54 devstack sudo[103388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:29:54 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:54 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1 1G" returned: 0 in 0.639s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9333cf60-eef9-4630-8e37-5e1d41539652 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:54 devstack sudo[103390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9333cf60-eef9-4630-8e37-5e1d41539652 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1
Aug 04 09:29:54 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "cinder-quobyte-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd" acquired by "delete_volume" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b62b9d-66f2-42ca-9252-4f65437da6ec]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:55 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.542s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:29:55 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Deleted volume successfully.
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35afd4e8-2219-4104-99b6-fee78220d65c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-94507acf-fc14-4d0b-8694-82b87dbe8e3e-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:55 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9333cf60-eef9-4630-8e37-5e1d41539652 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1" returned: 0 in 0.559s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:55 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1 is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:55 devstack sudo[103396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd
Aug 04 09:29:55 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:55 devstack sudo[103398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1
Aug 04 09:29:55 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:55 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd" returned: 0 in 0.584s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:55 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1" returned: 0 in 0.460s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:55 devstack sudo[103405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd
Aug 04 09:29:55 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:55 devstack sudo[103407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.info
Aug 04 09:29:55 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:55 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd" returned: 0 in 0.278s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-quobyte-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd" released by "delete_volume" :: held 0.987s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:55 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=192,cinder:INSERT=41,cinder:UPDATE=168,cinder:DELETE=9 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=161,cinder:INSERT=53,cinder:UPDATE=175,cinder:DELETE=10 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Created reservations ['9866e8c5-9152-49ee-904c-b491a6c00bf5', 'b0e62a19-966a-43ad-b728-5a3a09a0280b', '29da1a5b-2142-4e8c-8c13-49f487cc39b3', 'a87ab835-537d-48c6-b989-5aa51e0cceaa'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:29:56 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.info" returned: 0 in 0.385s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:56 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:56 devstack sudo[103411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.info
Aug 04 09:29:56 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:56 devstack sudo[103413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:29:56 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:56 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.280s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:29:56 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Deleted volume successfully.
Aug 04 09:29:56 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.info" returned: 0 in 0.398s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Acquiring lock "cinder-quobyte-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3" by "_copy_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a4fefc46-435b-402f-9ce7-014dac210a1c tempest-VolumesSnapshotTestJSON-503509665 None] Lock "cinder-6f9f2125-8f79-4a3e-ada6-cffae10ff6cd-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Lock "cinder-quobyte-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] snapshot: ed6862a1-c689-4bf8-b66e-40dbfffddcb1, volume: 9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3,  {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d6ea83-f72a-4984-8d0a-bda47f2a5435]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:56 devstack sudo[103417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1
Aug 04 09:29:56 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:57 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1" returned: 0 in 0.404s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9333cf60-eef9-4630-8e37-5e1d41539652(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:29:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Aug 04 09:29:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Creating direct copy from snapshot {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Aug 04 09:29:57 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[32456740-4596-49b6-b4ea-af6f311cbd11]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:29:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:57 devstack sudo[103422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652
Aug 04 09:29:57 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:29:57 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root
Aug 04 09:29:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652" returned: 0 in 0.476s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:29:57 devstack cinder-volume[88880]: DEBUG cinder.utils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Path /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3 not found in is_blk_device check {{(pid=88880) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 04 09:29:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:29:57 devstack sudo[103428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3
Aug 04 09:29:57 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:04 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3" returned: 0 in 7.148s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:04 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[70640fe9-75ff-498c-8ce6-8108c5092626]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:04 devstack sudo[103445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652
Aug 04 09:30:04 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:05 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652" returned: 0 in 0.954s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:05 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652, size 1024.00 MB, duration 7.15 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:30:05 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Converted 1024.00 MB image at 143.20 MB/s
Aug 04 09:30:05 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3 is being set with open permissions: ugo+rw: NotImplementedError
Aug 04 09:30:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:05 devstack sudo[103450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3
Aug 04 09:30:05 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:06 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3" returned: 0 in 0.356s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Lock "cinder-quobyte-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3" released by "_copy_volume_from_snapshot" :: held 9.469s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Acquiring lock "cinder-quobyte-ed6862a1-c689-4bf8-b66e-40dbfffddcb1" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Lock "cinder-quobyte-ed6862a1-c689-4bf8-b66e-40dbfffddcb1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Deleting offline snapshot ed6862a1-c689-4bf8-b66e-40dbfffddcb1 of volume 9333cf60-eef9-4630-8e37-5e1d41539652 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] snapshot_file for this snap is: volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a591afa-45c3-4873-97e4-116c735cd0c9]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:06 devstack sudo[103453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1
Aug 04 09:30:06 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:30:06 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1" returned: 0 in 0.534s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9333cf60-eef9-4630-8e37-5e1d41539652(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4f614f-a8c2-4a3b-beab-dfe4bdc39f58]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:06 devstack sudo[103459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652
Aug 04 09:30:06 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:07 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652" returned: 0 in 0.641s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:07 devstack sudo[103465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1
Aug 04 09:30:07 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:07 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1" returned: 0 in 0.481s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:07 devstack sudo[103470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1
Aug 04 09:30:07 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:08 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652.ed6862a1-c689-4bf8-b66e-40dbfffddcb1" returned: 0 in 0.307s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:08 devstack sudo[103473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:08 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Lock "cinder-quobyte-ed6862a1-c689-4bf8-b66e-40dbfffddcb1" released by "_delete_snapshot" :: held 2.107s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.828s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:08 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-23c89a22-4ccb-4f8b-b989-41633a377ff9 tempest-GroupsV314Test-690529561 None] Create group from source-group-5ce1a7e9-797a-4db7-91dc-fd016dc953c2 completed successfully.
Aug 04 09:30:08 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.355s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:30:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:30:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Acquiring lock "cinder-quobyte-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Lock "cinder-quobyte-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3" acquired by "delete_volume" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:09 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1c8060-470b-4159-b063-df07518b828e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:09 devstack sudo[103476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3
Aug 04 09:30:09 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:09 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3" returned: 0 in 0.402s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:09 devstack sudo[103482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3
Aug 04 09:30:09 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:10 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3" returned: 0 in 0.308s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Lock "cinder-quobyte-9bcde3dc-ddcb-4875-8b95-e8ad8eff8fe3" released by "delete_volume" :: held 0.770s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Created reservations ['924fbcd1-d24f-4d5d-a0f1-f7afd663d05a'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:10 devstack cinder-volume[88880]: WARNING cinder.quota [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-287909968 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-287909968, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:30:10 devstack cinder-volume[88880]: WARNING cinder.quota [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-287909968 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-287909968, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Created reservations ['a4c3aad5-f01d-46a2-910e-db101b03239a', '7862b18e-9ba9-4ea4-9dc4-5f818b2b62c4', '99a150e8-bc9e-4865-a6da-ef377e5c9fee', '81a5d27b-8910-4388-9079-9a703c48bd08'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Flow 'volume_create_manager' (aae2d087-483c-40b8-a0e5-ff930c8bfcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8a8be5-a4ac-4052-b1c5-7bfdbbefcd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8a8be5-a4ac-4052-b1c5-7bfdbbefcd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1933577948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c68cd3-b261-4509-a257-495225e16f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ee24c647e45a5956b045c43fdb5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:10Z,use_quota=True,user_id='79b19612ca834937a0cfb9d09f6a1024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9433a37-4e50-4e28-91ef-7c8dce762434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9433a37-4e50-4e28-91ef-7c8dce762434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ece3098-dffc-4ded-9b82-e1097bb6b8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ece3098-dffc-4ded-9b82-e1097bb6b8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52c68cd3-b261-4509-a257-495225e16f6e', 'volume_name': 'volume-52c68cd3-b261-4509-a257-495225e16f6e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b6e877-53c9-48bb-96ba-9818f6aa3da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b6e877-53c9-48bb-96ba-9818f6aa3da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf0080b-2571-4f47-a917-6a177a452f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:10 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Volume 52c68cd3-b261-4509-a257-495225e16f6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52c68cd3-b261-4509-a257-495225e16f6e', 'volume_size': 1}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1933577948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c68cd3-b261-4509-a257-495225e16f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ee24c647e45a5956b045c43fdb5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:10Z,use_quota=True,user_id='79b19612ca834937a0cfb9d09f6a1024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Creating volume 52c68cd3-b261-4509-a257-495225e16f6e {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:10 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52c68cd3-b261-4509-a257-495225e16f6e 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:10 devstack sudo[103556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52c68cd3-b261-4509-a257-495225e16f6e 1073741824
Aug 04 09:30:10 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:10 devstack sudo[103558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:10 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:11 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.379s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a9d326ab-e97f-4824-a3e0-9a244a1a608d tempest-GroupsV314Test-690529561 None] Delete group completed successfully.
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Flow 'volume_create_manager' (2a7802e8-456a-4f57-9498-8d23e6d85def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72db3c84-0b7d-4761-ad31-2b129b0c9cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72db3c84-0b7d-4761-ad31-2b129b0c9cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203610534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ee24c647e45a5956b045c43fdb5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:11Z,use_quota=True,user_id='79b19612ca834937a0cfb9d09f6a1024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be85589-fba0-4d27-bfd6-9ef989d9e73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be85589-fba0-4d27-bfd6-9ef989d9e73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8729715-bf8e-4ffe-af33-d019ad4311a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8729715-bf8e-4ffe-af33-d019ad4311a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7', 'volume_name': 'volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd76cb5-414f-4bd4-bd50-ef446a1fd682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd76cb5-414f-4bd4-bd50-ef446a1fd682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bcd2b8c-d8e5-4ce5-a546-6451b11e08ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:11 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Volume b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7', 'volume_size': 1}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Acquiring lock "cinder-quobyte-9333cf60-eef9-4630-8e37-5e1d41539652" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Lock "cinder-quobyte-9333cf60-eef9-4630-8e37-5e1d41539652" acquired by "delete_volume" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46cac50-4440-4cb3-8732-20ff69647d1e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:11 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52c68cd3-b261-4509-a257-495225e16f6e 1073741824" returned: 0 in 0.849s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52c68cd3-b261-4509-a257-495225e16f6e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:11 devstack sudo[103590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52c68cd3-b261-4509-a257-495225e16f6e
Aug 04 09:30:11 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Flow 'volume_create_manager' (5f54ac4d-c087-4299-8b74-16b7dd3fc27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:11 devstack sudo[103589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652
Aug 04 09:30:11 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914d40d7-14b9-44c0-b312-098c01fbaaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914d40d7-14b9-44c0-b312-098c01fbaaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-589764488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca6b78a-397d-476b-b6bc-b4fd1c518a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ee24c647e45a5956b045c43fdb5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:11Z,use_quota=True,user_id='79b19612ca834937a0cfb9d09f6a1024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d674a2e6-29e2-4dac-aded-056a060e9449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d674a2e6-29e2-4dac-aded-056a060e9449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6acb211-2d84-4851-90d2-df8b9c00eadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6acb211-2d84-4851-90d2-df8b9c00eadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ca6b78a-397d-476b-b6bc-b4fd1c518a84', 'volume_name': 'volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6cc4e1-ef2e-4a89-8d0f-3052582f0a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6cc4e1-ef2e-4a89-8d0f-3052582f0a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30464f13-6896-43b3-a1fc-0c4d20007f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:11 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Volume 5ca6b78a-397d-476b-b6bc-b4fd1c518a84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84', 'volume_size': 1}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:11 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52c68cd3-b261-4509-a257-495225e16f6e" returned: 0 in 0.395s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203610534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ee24c647e45a5956b045c43fdb5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:11Z,use_quota=True,user_id='79b19612ca834937a0cfb9d09f6a1024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Creating volume b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:11 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf0080b-2571-4f47-a917-6a177a452f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c68cd3-b261-4509-a257-495225e16f6e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c37b45-8604-4376-a912-a7db18e5bed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:11 devstack sudo[103597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7 1073741824
Aug 04 09:30:11 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:11 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652" returned: 0 in 0.578s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:11 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Volume volume-52c68cd3-b261-4509-a257-495225e16f6e (52c68cd3-b261-4509-a257-495225e16f6e): created successfully
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c37b45-8604-4376-a912-a7db18e5bed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Flow 'volume_create_manager' (aae2d087-483c-40b8-a0e5-ff930c8bfcbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:11 devstack sudo[103599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652
Aug 04 09:30:11 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-cec8894e-2c73-4be6-bdf7-8231c61be705 tempest-CreateVolumesFromImageTest-2093622043 None] Created volume successfully.
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Flow 'volume_create_manager' (d16dcc53-5cc8-4dca-aa6e-2bdaae1007ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:12 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583fcfa2-694d-48be-962f-a38a11e26bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9333cf60-eef9-4630-8e37-5e1d41539652" returned: 0 in 0.314s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583fcfa2-694d-48be-962f-a38a11e26bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1596541315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208c1be1-66a5-4a68-ae25-1bf7f8e729f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ee24c647e45a5956b045c43fdb5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:12Z,use_quota=True,user_id='79b19612ca834937a0cfb9d09f6a1024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30105e13-1a32-4664-99cc-07d4344ac0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30105e13-1a32-4664-99cc-07d4344ac0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8de5c7-a257-4384-8741-14401ff15549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8de5c7-a257-4384-8741-14401ff15549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208c1be1-66a5-4a68-ae25-1bf7f8e729f1', 'volume_name': 'volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cccd8b4-3617-4344-ac2a-7e434aec68f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cccd8b4-3617-4344-ac2a-7e434aec68f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64cefaf-518b-4b9c-9e88-fe3d27afab32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:12 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Volume 208c1be1-66a5-4a68-ae25-1bf7f8e729f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1', 'volume_size': 1}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Lock "cinder-quobyte-9333cf60-eef9-4630-8e37-5e1d41539652" released by "delete_volume" :: held 1.046s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Created reservations ['2f760661-6556-4244-b33b-0df99309783e'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Created reservations ['d225bc3d-1ffe-4895-814b-e2d8c3370893', 'e8fc0a36-1bbd-40fe-9d45-6285d042de82', 'fdae2e0a-438e-4e3e-a9cd-0148045bb483', '694e438d-206f-4d29-b2a0-4d1a65203703'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:12 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7 1073741824" returned: 0 in 0.696s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:12 devstack sudo[103606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7
Aug 04 09:30:12 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Flow 'volume_create_manager' (92def979-ecee-409f-b87b-c53e4d3f8d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcac2dc0-ea58-479e-950e-f79b286fe39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcac2dc0-ea58-479e-950e-f79b286fe39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-262298664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ee24c647e45a5956b045c43fdb5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:13Z,use_quota=True,user_id='79b19612ca834937a0cfb9d09f6a1024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf38fef5-aca3-4ad2-b23d-da2a761fd006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:12 devstack sudo[103608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:12 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf38fef5-aca3-4ad2-b23d-da2a761fd006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6796d626-c665-4aad-8c52-2fb8da251427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6796d626-c665-4aad-8c52-2fb8da251427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083', 'volume_name': 'volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aab9424-8f88-4237-b175-9f05509b2454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aab9424-8f88-4237-b175-9f05509b2454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4004e083-6e1a-41c0-b058-5a785a599309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:12 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Volume fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083', 'volume_size': 1}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:12 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7" returned: 0 in 0.271s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.227s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-589764488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca6b78a-397d-476b-b6bc-b4fd1c518a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ee24c647e45a5956b045c43fdb5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:11Z,use_quota=True,user_id='79b19612ca834937a0cfb9d09f6a1024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Creating volume 5ca6b78a-397d-476b-b6bc-b4fd1c518a84 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:12 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bcd2b8c-d8e5-4ce5-a546-6451b11e08ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:12 devstack sudo[103611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84 1073741824
Aug 04 09:30:12 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12475b90-d844-4891-b0fe-af3b05ee862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:12 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Volume volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7 (b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7): created successfully
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12475b90-d844-4891-b0fe-af3b05ee862f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Flow 'volume_create_manager' (2a7802e8-456a-4f57-9498-8d23e6d85def) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:12 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.251s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:12 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:12 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b867400c-7729-459a-9dd4-1c923c53c824 tempest-CreateVolumesFromImageTest-2093622043 None] Created volume successfully.
Aug 04 09:30:12 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d64b3bfc-4761-4541-9835-b26c3601c0ac tempest-GroupsV314Test-690529561 None] Delete group completed successfully.
Aug 04 09:30:13 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84 1073741824" returned: 0 in 0.424s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:13 devstack sudo[103617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84
Aug 04 09:30:13 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:13 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84" returned: 0 in 0.242s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.272s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1596541315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208c1be1-66a5-4a68-ae25-1bf7f8e729f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ee24c647e45a5956b045c43fdb5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:12Z,use_quota=True,user_id='79b19612ca834937a0cfb9d09f6a1024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Creating volume 208c1be1-66a5-4a68-ae25-1bf7f8e729f1 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:13 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30464f13-6896-43b3-a1fc-0c4d20007f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:13 devstack sudo[103620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1 1073741824
Aug 04 09:30:13 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1eefec8-cf64-46f8-b75e-d0e17d2c2023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:13 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Volume volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84 (5ca6b78a-397d-476b-b6bc-b4fd1c518a84): created successfully
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1eefec8-cf64-46f8-b75e-d0e17d2c2023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Flow 'volume_create_manager' (5f54ac4d-c087-4299-8b74-16b7dd3fc27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4313b211-fc3f-43e3-83c3-cb73f85ec8a4 tempest-CreateVolumesFromImageTest-2093622043 None] Created volume successfully.
Aug 04 09:30:14 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1 1073741824" returned: 0 in 0.433s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:14 devstack sudo[103626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1
Aug 04 09:30:14 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:14 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1" returned: 0 in 0.254s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.574s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-262298664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ee24c647e45a5956b045c43fdb5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:13Z,use_quota=True,user_id='79b19612ca834937a0cfb9d09f6a1024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Creating volume fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:14 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64cefaf-518b-4b9c-9e88-fe3d27afab32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:14 devstack sudo[103629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083 1073741824
Aug 04 09:30:14 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ad6589-2d85-46b4-b789-52b24712fd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:14 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Volume volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1 (208c1be1-66a5-4a68-ae25-1bf7f8e729f1): created successfully
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ad6589-2d85-46b4-b789-52b24712fd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Flow 'volume_create_manager' (d16dcc53-5cc8-4dca-aa6e-2bdaae1007ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:14 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-bbd32457-250c-4dc7-8f98-576581eca3fb tempest-CreateVolumesFromImageTest-2093622043 None] Created volume successfully.
Aug 04 09:30:14 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083 1073741824" returned: 0 in 0.536s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:14 devstack sudo[103637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083
Aug 04 09:30:14 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:15 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083" returned: 0 in 0.268s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4004e083-6e1a-41c0-b058-5a785a599309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82005e21-9255-4ac4-ae58-0c1f7f362b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:15 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Volume volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083 (fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083): created successfully
Aug 04 09:30:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82005e21-9255-4ac4-ae58-0c1f7f362b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Flow 'volume_create_manager' (92def979-ecee-409f-b87b-c53e4d3f8d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:15 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-642acc35-e8ec-45ce-8e5f-981ddf75d014 tempest-CreateVolumesFromImageTest-2093622043 None] Created volume successfully.
Aug 04 09:30:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "cinder-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "cinder-quobyte-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-quobyte-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083" acquired by "delete_volume" :: waited 0.012s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec31bbcc-194b-4b6c-9dd0-595937d4c94b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:16 devstack sudo[103641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083
Aug 04 09:30:16 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:16 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083" returned: 0 in 0.376s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:16 devstack sudo[103646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083
Aug 04 09:30:16 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:16 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083" returned: 0 in 0.265s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-quobyte-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083" released by "delete_volume" :: held 0.689s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Created reservations ['6e225ae1-b5ca-4594-9ac0-b2aca9cb044a', 'c7c5807e-485a-4235-8da9-cf5097a6cd9b', 'f27e4e7b-74e0-4fd6-b407-29700362319c', '4177d017-4b06-4418-83b2-064a9f436eec'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:16 devstack sudo[103649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:16 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:17 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.247s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:17 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Deleted volume successfully.
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "cinder-208c1be1-66a5-4a68-ae25-1bf7f8e729f1-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e0fb339f-d14d-4333-8044-b251f99eb7cc tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-fa0cb7ec-8f0a-4a40-9422-b40d8fd4a083-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-208c1be1-66a5-4a68-ae25-1bf7f8e729f1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "cinder-quobyte-208c1be1-66a5-4a68-ae25-1bf7f8e729f1" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-quobyte-208c1be1-66a5-4a68-ae25-1bf7f8e729f1" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[885bef41-31bd-4fe2-b41f-ec0f032fe63d]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:17 devstack sudo[103652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1
Aug 04 09:30:17 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:17 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1" returned: 0 in 0.388s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:17 devstack sudo[103657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1
Aug 04 09:30:17 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:17 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-208c1be1-66a5-4a68-ae25-1bf7f8e729f1" returned: 0 in 0.266s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-quobyte-208c1be1-66a5-4a68-ae25-1bf7f8e729f1" released by "delete_volume" :: held 0.709s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Created reservations ['64ffedff-58cd-4075-9d00-107c89873b2c', '7974e12c-4e63-4d4b-a90f-4da894740112', 'f7a1bd98-cc00-42b6-9cfd-5cc5d921faed', 'cb93ddb1-3a90-4ab9-ae8f-a9b78b1431d2'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:18 devstack sudo[103660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:18 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "cinder-5ca6b78a-397d-476b-b6bc-b4fd1c518a84-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-5ca6b78a-397d-476b-b6bc-b4fd1c518a84-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "cinder-quobyte-5ca6b78a-397d-476b-b6bc-b4fd1c518a84" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:18 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.393s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-quobyte-5ca6b78a-397d-476b-b6bc-b4fd1c518a84" acquired by "delete_volume" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:18 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Deleted volume successfully.
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9f1864ef-a85d-4320-95c5-87660abf8f29 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-208c1be1-66a5-4a68-ae25-1bf7f8e729f1-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70a23ec-67d3-42f1-91bb-eefdf9646eca]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:18 devstack sudo[103663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84
Aug 04 09:30:18 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:18 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84" returned: 0 in 0.377s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:18 devstack sudo[103668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84
Aug 04 09:30:18 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:19 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5ca6b78a-397d-476b-b6bc-b4fd1c518a84" returned: 0 in 0.289s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-quobyte-5ca6b78a-397d-476b-b6bc-b4fd1c518a84" released by "delete_volume" :: held 0.730s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Created reservations ['3e46bbfe-1a96-42ef-ab57-6867739a75a2', '50f876b4-ba19-41c3-be7f-e5fc627c61ed', 'c169c7c5-b6a1-461e-b7a4-40938121babc', 'e0320f37-3054-4b85-9ed1-81676c204e48'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:19 devstack sudo[103671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:19 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "cinder-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:19 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.305s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:19 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Deleted volume successfully.
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "cinder-quobyte-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-77668f01-2040-4822-9273-0ebd395e2258 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-5ca6b78a-397d-476b-b6bc-b4fd1c518a84-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-quobyte-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7" acquired by "delete_volume" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eea066-0e83-4f70-ada7-f47669d91db6]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:19 devstack sudo[103675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7
Aug 04 09:30:19 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:20 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7" returned: 0 in 0.408s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:20 devstack sudo[103681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7
Aug 04 09:30:20 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:20 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7" returned: 0 in 0.304s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-quobyte-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7" released by "delete_volume" :: held 0.761s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Created reservations ['48672799-4fe6-410a-8279-45695c5a453b', 'eaae3725-d8e9-4d75-9939-e134cea8923e', '92fd00cb-799e-439a-9782-27611091bfa0', '9e6498ed-2964-43f8-ba79-c854f521eabd'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:20 devstack sudo[103685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:20 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "cinder-52c68cd3-b261-4509-a257-495225e16f6e-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-52c68cd3-b261-4509-a257-495225e16f6e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "cinder-quobyte-52c68cd3-b261-4509-a257-495225e16f6e" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-quobyte-52c68cd3-b261-4509-a257-495225e16f6e" acquired by "delete_volume" :: waited 0.014s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[00689a0a-1bdd-4340-9640-b7c904519912]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52c68cd3-b261-4509-a257-495225e16f6e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:20 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.315s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:20 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:20 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Deleted volume successfully.
Aug 04 09:30:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35816e05-575f-456f-9a37-2a2a9e90b914 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-b1a2aa3e-0caf-4c5b-a035-f4d3027df4e7-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:21 devstack sudo[103688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52c68cd3-b261-4509-a257-495225e16f6e
Aug 04 09:30:21 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:21 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52c68cd3-b261-4509-a257-495225e16f6e" returned: 0 in 0.373s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52c68cd3-b261-4509-a257-495225e16f6e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:21 devstack sudo[103693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52c68cd3-b261-4509-a257-495225e16f6e
Aug 04 09:30:21 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:21 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-52c68cd3-b261-4509-a257-495225e16f6e" returned: 0 in 0.259s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-quobyte-52c68cd3-b261-4509-a257-495225e16f6e" released by "delete_volume" :: held 0.675s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:21 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Created reservations ['8a224a1b-6e9e-4a5a-a3bb-27107d6c6ecb', '553961da-76a9-41d5-8dff-58946aba40db', 'a4c15278-cc54-4894-a4a0-8625bb587fa6', '3a751993-6996-4e43-a1f8-6d4ab9126031'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:21 devstack sudo[103700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:21 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:22 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.272s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:22 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:22 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Deleted volume successfully.
Aug 04 09:30:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e4fd3ec4-3e10-4159-a0bd-7ad74323c9f6 tempest-CreateVolumesFromImageTest-2093622043 None] Lock "cinder-52c68cd3-b261-4509-a257-495225e16f6e-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-cc561e88-dc37-47e2-ac63-9fe173cb025f req-009d852b-3455-4549-9bb5-13446fdd1ffd tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-cc561e88-dc37-47e2-ac63-9fe173cb025f req-009d852b-3455-4549-9bb5-13446fdd1ffd tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:23 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a8974-a255-4bca-b1cd-bcb9522193b2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-cc561e88-dc37-47e2-ac63-9fe173cb025f req-009d852b-3455-4549-9bb5-13446fdd1ffd tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:23 devstack sudo[103714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c
Aug 04 09:30:23 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:23 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-cc561e88-dc37-47e2-ac63-9fe173cb025f req-009d852b-3455-4549-9bb5-13446fdd1ffd tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c" returned: 0 in 0.448s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-cc561e88-dc37-47e2-ac63-9fe173cb025f req-009d852b-3455-4549-9bb5-13446fdd1ffd tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.472s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-cc561e88-dc37-47e2-ac63-9fe173cb025f req-009d852b-3455-4549-9bb5-13446fdd1ffd tempest-TestInstancesWithCinderVolumes-268566882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97ba5f39-5946-49e4-bc45-10326870262f', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:30:23 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-cc561e88-dc37-47e2-ac63-9fe173cb025f req-009d852b-3455-4549-9bb5-13446fdd1ffd tempest-TestInstancesWithCinderVolumes-268566882 None] attachment_update completed successfully.
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Flow 'volume_create_manager' (69f012c6-7491-47b6-82f9-b4645dee4128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ce463c-9efc-41e4-ac59-5456cbf65bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ce463c-9efc-41e4-ac59-5456cbf65bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-249548062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538f649f-f892-456a-8eca-8747fd9a2473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d850aa05014decbaeb03a355f65fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:26Z,use_quota=True,user_id='3d1f771c381043f69fa207837518ed2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2889005f-a34f-40fb-99bc-f7cd82fbae32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2889005f-a34f-40fb-99bc-f7cd82fbae32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca13e3c2-fce6-4439-89e8-28c2f2f29c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca13e3c2-fce6-4439-89e8-28c2f2f29c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '538f649f-f892-456a-8eca-8747fd9a2473', 'volume_name': 'volume-538f649f-f892-456a-8eca-8747fd9a2473', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcec788-a53a-45ad-b45e-9901855c5e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcec788-a53a-45ad-b45e-9901855c5e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472f34d1-f102-4b93-97c3-c023fe400b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:25 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume 538f649f-f892-456a-8eca-8747fd9a2473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-538f649f-f892-456a-8eca-8747fd9a2473', 'volume_size': 1}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-249548062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538f649f-f892-456a-8eca-8747fd9a2473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d850aa05014decbaeb03a355f65fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:26Z,use_quota=True,user_id='3d1f771c381043f69fa207837518ed2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Creating volume 538f649f-f892-456a-8eca-8747fd9a2473 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:25 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-538f649f-f892-456a-8eca-8747fd9a2473 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:25 devstack sudo[103734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-538f649f-f892-456a-8eca-8747fd9a2473 1073741824
Aug 04 09:30:25 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-7ca83ac7-88c2-4386-bffc-283ab4a6e449 req-7b6ce4c0-05fc-4ec8-8a43-cd09f25f51e7 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:26 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-538f649f-f892-456a-8eca-8747fd9a2473 1073741824" returned: 0 in 0.556s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-538f649f-f892-456a-8eca-8747fd9a2473 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:26 devstack sudo[103749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-538f649f-f892-456a-8eca-8747fd9a2473
Aug 04 09:30:26 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:26 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-538f649f-f892-456a-8eca-8747fd9a2473" returned: 0 in 0.280s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-7ca83ac7-88c2-4386-bffc-283ab4a6e449 req-7b6ce4c0-05fc-4ec8-8a43-cd09f25f51e7 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.552s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472f34d1-f102-4b93-97c3-c023fe400b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538f649f-f892-456a-8eca-8747fd9a2473', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcca56da-031d-49cb-9441-22ee29dc1703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a91eaed-ee2c-4371-abf2-6f2cbb30c897]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-7ca83ac7-88c2-4386-bffc-283ab4a6e449 req-7b6ce4c0-05fc-4ec8-8a43-cd09f25f51e7 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:26 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume volume-538f649f-f892-456a-8eca-8747fd9a2473 (538f649f-f892-456a-8eca-8747fd9a2473): created successfully
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcca56da-031d-49cb-9441-22ee29dc1703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Flow 'volume_create_manager' (69f012c6-7491-47b6-82f9-b4645dee4128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:26 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-595aea28-1f8c-4ef6-b5b3-9ead0980373d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Created volume successfully.
Aug 04 09:30:26 devstack sudo[103752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643
Aug 04 09:30:26 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:27 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-7ca83ac7-88c2-4386-bffc-283ab4a6e449 req-7b6ce4c0-05fc-4ec8-8a43-cd09f25f51e7 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643" returned: 0 in 0.378s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-7ca83ac7-88c2-4386-bffc-283ab4a6e449 req-7b6ce4c0-05fc-4ec8-8a43-cd09f25f51e7 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.405s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:27 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-7ca83ac7-88c2-4386-bffc-283ab4a6e449 req-7b6ce4c0-05fc-4ec8-8a43-cd09f25f51e7 tempest-TestInstancesWithCinderVolumes-268566882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-bb9a81b0-80c8-406b-a767-e05a2b454643', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aadc23cb-8bde-4269-b320-bf6c6b9f7a7c', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:30:27 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-7ca83ac7-88c2-4386-bffc-283ab4a6e449 req-7b6ce4c0-05fc-4ec8-8a43-cd09f25f51e7 tempest-TestInstancesWithCinderVolumes-268566882 None] attachment_update completed successfully.
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Flow 'volume_create_manager' (71a6a4a1-0df0-4f1d-8e24-ca2a9a2daff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f4e1fa-6310-4e2b-8464-136a2f641698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f4e1fa-6310-4e2b-8464-136a2f641698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-923053716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425564e4-435e-466a-9b39-4d2e95768828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d850aa05014decbaeb03a355f65fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:29Z,use_quota=True,user_id='3d1f771c381043f69fa207837518ed2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e115a23-e8eb-4880-af56-972905e6ae8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e115a23-e8eb-4880-af56-972905e6ae8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f063894-1b06-4c7b-b7a4-2944045ec89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f063894-1b06-4c7b-b7a4-2944045ec89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425564e4-435e-466a-9b39-4d2e95768828', 'volume_name': 'volume-425564e4-435e-466a-9b39-4d2e95768828', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e80191a-60ca-4c63-984e-1eaa3bdecf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e80191a-60ca-4c63-984e-1eaa3bdecf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d38d95-2acd-4481-b50d-708dc70da49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:28 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume 425564e4-435e-466a-9b39-4d2e95768828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425564e4-435e-466a-9b39-4d2e95768828', 'volume_size': 1}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-923053716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425564e4-435e-466a-9b39-4d2e95768828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d850aa05014decbaeb03a355f65fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:29Z,use_quota=True,user_id='3d1f771c381043f69fa207837518ed2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Creating volume 425564e4-435e-466a-9b39-4d2e95768828 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:28 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-425564e4-435e-466a-9b39-4d2e95768828 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:28 devstack sudo[103772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-425564e4-435e-466a-9b39-4d2e95768828 1073741824
Aug 04 09:30:28 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Flow 'volume_create_manager' (a81f0a1e-ee6f-4fce-9a1b-397b1fb4d376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478cbc75-fcce-4ea0-b3d8-8d13479a570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478cbc75-fcce-4ea0-b3d8-8d13479a570d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-192542029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456478a9-9d5b-4c3a-8c70-d2131af707ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d850aa05014decbaeb03a355f65fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:29Z,use_quota=True,user_id='3d1f771c381043f69fa207837518ed2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491abd4d-c307-4420-9364-3d2af2a4f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491abd4d-c307-4420-9364-3d2af2a4f204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa230881-bb75-4a68-a4cd-2d177e31bf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa230881-bb75-4a68-a4cd-2d177e31bf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456478a9-9d5b-4c3a-8c70-d2131af707ec', 'volume_name': 'volume-456478a9-9d5b-4c3a-8c70-d2131af707ec', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ca6ffa-1f4c-4b28-a44a-f96b9ada1a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ca6ffa-1f4c-4b28-a44a-f96b9ada1a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff18a74f-2347-4247-89b5-622fb697a4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:29 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume 456478a9-9d5b-4c3a-8c70-d2131af707ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456478a9-9d5b-4c3a-8c70-d2131af707ec', 'volume_size': 1}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:29 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-425564e4-435e-466a-9b39-4d2e95768828 1073741824" returned: 0 in 0.615s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-425564e4-435e-466a-9b39-4d2e95768828 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:29 devstack sudo[103778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-425564e4-435e-466a-9b39-4d2e95768828
Aug 04 09:30:29 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Flow 'volume_create_manager' (67216732-2b78-4b3d-b262-58d5b1ccd385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283c4e1d-093a-41de-a10f-6b0783e78cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283c4e1d-093a-41de-a10f-6b0783e78cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-399739379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbbe07a-6194-4852-a82e-d49e45c17a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d850aa05014decbaeb03a355f65fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:30Z,use_quota=True,user_id='3d1f771c381043f69fa207837518ed2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8730754-c36e-4526-9e14-0f78ea155e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8730754-c36e-4526-9e14-0f78ea155e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7974bf-aab7-4f5b-88ef-c79eac233e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7974bf-aab7-4f5b-88ef-c79eac233e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fbbe07a-6194-4852-a82e-d49e45c17a29', 'volume_name': 'volume-7fbbe07a-6194-4852-a82e-d49e45c17a29', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c07058-9cd1-43e9-99d2-ef21becb1fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c07058-9cd1-43e9-99d2-ef21becb1fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bd5a57-2305-4fe3-91f4-db9db66d7878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:29 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume 7fbbe07a-6194-4852-a82e-d49e45c17a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fbbe07a-6194-4852-a82e-d49e45c17a29', 'volume_size': 1}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:29 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-425564e4-435e-466a-9b39-4d2e95768828" returned: 0 in 0.365s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-192542029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456478a9-9d5b-4c3a-8c70-d2131af707ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d850aa05014decbaeb03a355f65fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:29Z,use_quota=True,user_id='3d1f771c381043f69fa207837518ed2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Creating volume 456478a9-9d5b-4c3a-8c70-d2131af707ec {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:29 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-456478a9-9d5b-4c3a-8c70-d2131af707ec 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d38d95-2acd-4481-b50d-708dc70da49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425564e4-435e-466a-9b39-4d2e95768828', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:29 devstack sudo[103782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-456478a9-9d5b-4c3a-8c70-d2131af707ec 1073741824
Aug 04 09:30:29 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa9ae50-344d-46eb-a419-b2c573e95555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:29 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume volume-425564e4-435e-466a-9b39-4d2e95768828 (425564e4-435e-466a-9b39-4d2e95768828): created successfully
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa9ae50-344d-46eb-a419-b2c573e95555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Flow 'volume_create_manager' (71a6a4a1-0df0-4f1d-8e24-ca2a9a2daff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:29 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-0772b286-4299-4b9a-8ce5-7737b4b3f26d tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Created volume successfully.
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Flow 'volume_create_manager' (3cf5ad2b-9e82-4275-9ed6-6e161d651fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9b5866-9664-4035-aa24-aacf0ee05171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9b5866-9664-4035-aa24-aacf0ee05171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-175472555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9f584a-56a4-422b-8175-8eec0008ffdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d850aa05014decbaeb03a355f65fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:30Z,use_quota=True,user_id='3d1f771c381043f69fa207837518ed2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07871fca-5213-496c-a822-4f7e32b78c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07871fca-5213-496c-a822-4f7e32b78c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c16feea-0fbc-4c33-8c1d-5a7e7ed498ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c16feea-0fbc-4c33-8c1d-5a7e7ed498ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9f584a-56a4-422b-8175-8eec0008ffdb', 'volume_name': 'volume-dd9f584a-56a4-422b-8175-8eec0008ffdb', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8443cdd7-cd0c-4f6c-ba66-f3d319238ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8443cdd7-cd0c-4f6c-ba66-f3d319238ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abdb225-77cf-41be-9b2c-cf8e12a30069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume dd9f584a-56a4-422b-8175-8eec0008ffdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9f584a-56a4-422b-8175-8eec0008ffdb', 'volume_size': 1}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-456478a9-9d5b-4c3a-8c70-d2131af707ec 1073741824" returned: 0 in 0.705s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-456478a9-9d5b-4c3a-8c70-d2131af707ec {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:30 devstack sudo[103788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-456478a9-9d5b-4c3a-8c70-d2131af707ec
Aug 04 09:30:30 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Flow 'volume_create_manager' (de2d36c5-4a91-4641-86d8-6b4db8d25ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd2657d-bb5c-4435-a358-808f8089026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd2657d-bb5c-4435-a358-808f8089026b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1549237272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fcdf08-20c0-435c-ba01-d5403f211be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e292514b64ec46d5a7d5953c3a4b2ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:31Z,use_quota=True,user_id='33c9eecf196847d789d2762bf127ecb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4680c37-920c-4d93-800f-ed8f144fcb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4680c37-920c-4d93-800f-ed8f144fcb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd1774f-d053-4303-825a-9c6e3eb331db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd1774f-d053-4303-825a-9c6e3eb331db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63fcdf08-20c0-435c-ba01-d5403f211be4', 'volume_name': 'volume-63fcdf08-20c0-435c-ba01-d5403f211be4', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c53fff6-0687-47c9-ac69-0e72f0f34a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c53fff6-0687-47c9-ac69-0e72f0f34a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9b82b1-4387-4587-8871-4a1c5f9eab4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Volume 63fcdf08-20c0-435c-ba01-d5403f211be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63fcdf08-20c0-435c-ba01-d5403f211be4', 'volume_size': 1}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:30 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Flow 'volume_create_manager' (183d0f9a-e662-471c-869b-96db2a78e850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b834e4-f03f-440e-ab75-e418b2eedf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-456478a9-9d5b-4c3a-8c70-d2131af707ec" returned: 0 in 0.269s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.046s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-399739379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbbe07a-6194-4852-a82e-d49e45c17a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d850aa05014decbaeb03a355f65fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:30Z,use_quota=True,user_id='3d1f771c381043f69fa207837518ed2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Creating volume 7fbbe07a-6194-4852-a82e-d49e45c17a29 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:30 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbbe07a-6194-4852-a82e-d49e45c17a29 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b834e4-f03f-440e-ab75-e418b2eedf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-207979740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be0743b-ece3-4ef3-9024-5e8e7117f7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d850aa05014decbaeb03a355f65fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:31Z,use_quota=True,user_id='3d1f771c381043f69fa207837518ed2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack sudo[103791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbbe07a-6194-4852-a82e-d49e45c17a29 1073741824
Aug 04 09:30:30 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610bd436-acec-469b-b4f2-cff18bf5cace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610bd436-acec-469b-b4f2-cff18bf5cace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c899fb62-fc5f-470a-96f7-0dfe68c1bc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c899fb62-fc5f-470a-96f7-0dfe68c1bc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be0743b-ece3-4ef3-9024-5e8e7117f7f7', 'volume_name': 'volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cdfb0a-c3ac-492c-95d9-d7fb7454d665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cdfb0a-c3ac-492c-95d9-d7fb7454d665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f5318b-e590-4704-a8f9-d785adf7932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume 4be0743b-ece3-4ef3-9024-5e8e7117f7f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7', 'volume_size': 1}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff18a74f-2347-4247-89b5-622fb697a4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456478a9-9d5b-4c3a-8c70-d2131af707ec', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55507f05-7d31-4d63-83b5-0b4951f3bd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume volume-456478a9-9d5b-4c3a-8c70-d2131af707ec (456478a9-9d5b-4c3a-8c70-d2131af707ec): created successfully
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55507f05-7d31-4d63-83b5-0b4951f3bd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Flow 'volume_create_manager' (a81f0a1e-ee6f-4fce-9a1b-397b1fb4d376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:30 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-db0e0905-3000-4d72-85b1-04253498e541 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Created volume successfully.
Aug 04 09:30:31 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbbe07a-6194-4852-a82e-d49e45c17a29 1073741824" returned: 0 in 0.447s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbbe07a-6194-4852-a82e-d49e45c17a29 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:31 devstack sudo[103803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbbe07a-6194-4852-a82e-d49e45c17a29
Aug 04 09:30:31 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:31 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbbe07a-6194-4852-a82e-d49e45c17a29" returned: 0 in 0.241s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-175472555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9f584a-56a4-422b-8175-8eec0008ffdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d850aa05014decbaeb03a355f65fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:30Z,use_quota=True,user_id='3d1f771c381043f69fa207837518ed2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Creating volume dd9f584a-56a4-422b-8175-8eec0008ffdb {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:31 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dd9f584a-56a4-422b-8175-8eec0008ffdb 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:31 devstack sudo[103810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dd9f584a-56a4-422b-8175-8eec0008ffdb 1073741824
Aug 04 09:30:31 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bd5a57-2305-4fe3-91f4-db9db66d7878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbbe07a-6194-4852-a82e-d49e45c17a29', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabe497f-9576-4f30-9502-f18500830e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:31 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume volume-7fbbe07a-6194-4852-a82e-d49e45c17a29 (7fbbe07a-6194-4852-a82e-d49e45c17a29): created successfully
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabe497f-9576-4f30-9502-f18500830e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Flow 'volume_create_manager' (67216732-2b78-4b3d-b262-58d5b1ccd385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:31 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d5fee738-dac7-422a-841d-f2420b2c7598 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Created volume successfully.
Aug 04 09:30:32 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dd9f584a-56a4-422b-8175-8eec0008ffdb 1073741824" returned: 0 in 0.441s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dd9f584a-56a4-422b-8175-8eec0008ffdb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:32 devstack sudo[103824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dd9f584a-56a4-422b-8175-8eec0008ffdb
Aug 04 09:30:32 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:32 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dd9f584a-56a4-422b-8175-8eec0008ffdb" returned: 0 in 0.244s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.513s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1549237272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fcdf08-20c0-435c-ba01-d5403f211be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e292514b64ec46d5a7d5953c3a4b2ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:31Z,use_quota=True,user_id='33c9eecf196847d789d2762bf127ecb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Creating volume 63fcdf08-20c0-435c-ba01-d5403f211be4 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:32 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-63fcdf08-20c0-435c-ba01-d5403f211be4 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abdb225-77cf-41be-9b2c-cf8e12a30069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9f584a-56a4-422b-8175-8eec0008ffdb', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:32 devstack sudo[103831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-63fcdf08-20c0-435c-ba01-d5403f211be4 1073741824
Aug 04 09:30:32 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed2a3b1-d82c-4778-a4df-27a52cc4baf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:32 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume volume-dd9f584a-56a4-422b-8175-8eec0008ffdb (dd9f584a-56a4-422b-8175-8eec0008ffdb): created successfully
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed2a3b1-d82c-4778-a4df-27a52cc4baf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Flow 'volume_create_manager' (3cf5ad2b-9e82-4275-9ed6-6e161d651fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:32 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b5a43c4e-bcf2-4550-b6ac-9267eff45a79 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Created volume successfully.
Aug 04 09:30:32 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-63fcdf08-20c0-435c-ba01-d5403f211be4 1073741824" returned: 0 in 0.557s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-63fcdf08-20c0-435c-ba01-d5403f211be4 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:32 devstack sudo[103838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-63fcdf08-20c0-435c-ba01-d5403f211be4
Aug 04 09:30:32 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:33 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-63fcdf08-20c0-435c-ba01-d5403f211be4" returned: 0 in 0.243s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.251s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-207979740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be0743b-ece3-4ef3-9024-5e8e7117f7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d850aa05014decbaeb03a355f65fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:31Z,use_quota=True,user_id='3d1f771c381043f69fa207837518ed2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Creating volume 4be0743b-ece3-4ef3-9024-5e8e7117f7f7 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:33 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:33 devstack sudo[103845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7 1073741824
Aug 04 09:30:33 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9b82b1-4387-4587-8871-4a1c5f9eab4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63fcdf08-20c0-435c-ba01-d5403f211be4', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5c9e4a-ac95-41dd-87f9-0bde051cf7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:33 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-e13096fb-ee5a-4452-9d93-aa906a69c1a6 req-da3d843e-9030-475c-838c-5186ebd4ad41 tempest-TestInstancesWithCinderVolumes-268566882 None] Terminate volume connection completed successfully.
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-e13096fb-ee5a-4452-9d93-aa906a69c1a6 req-da3d843e-9030-475c-838c-5186ebd4ad41 tempest-TestInstancesWithCinderVolumes-268566882 None] Deleting attachment 97ba5f39-5946-49e4-bc45-10326870262f. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:30:33 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Volume volume-63fcdf08-20c0-435c-ba01-d5403f211be4 (63fcdf08-20c0-435c-ba01-d5403f211be4): created successfully
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5c9e4a-ac95-41dd-87f9-0bde051cf7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Flow 'volume_create_manager' (de2d36c5-4a91-4641-86d8-6b4db8d25ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:33 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1e80aaa2-4d92-4468-9643-72d692aed2e7 tempest-VolumesListAdminTestJSON-1541963730 None] Created volume successfully.
Aug 04 09:30:33 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7 1073741824" returned: 0 in 0.543s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:33 devstack sudo[103851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7
Aug 04 09:30:33 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "cinder-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "cinder-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "cinder-quobyte-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "cinder-quobyte-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec6eafc-6022-4055-965f-3f9cc71f1219]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:34 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7" returned: 0 in 0.299s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f5318b-e590-4704-a8f9-d785adf7932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dcec567-9c1e-45fb-9280-2100722c27f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:34 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Volume volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7 (4be0743b-ece3-4ef3-9024-5e8e7117f7f7): created successfully
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dcec567-9c1e-45fb-9280-2100722c27f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Flow 'volume_create_manager' (183d0f9a-e662-471c-869b-96db2a78e850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:34 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f96d6163-54e2-46f0-9073-444669feead3 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Created volume successfully.
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:34 devstack sudo[103858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c
Aug 04 09:30:34 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Flow 'volume_create_manager' (5c0d10a0-e7c8-4d65-9227-52db6519eb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1308f3-f933-4dbf-8d43-0cc8d85883c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1308f3-f933-4dbf-8d43-0cc8d85883c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2077142392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4d6527-fced-4ce7-85c9-726045f6837c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e292514b64ec46d5a7d5953c3a4b2ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:34Z,use_quota=True,user_id='33c9eecf196847d789d2762bf127ecb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0712a0ab-e224-4153-b7c4-10b5be03b83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0712a0ab-e224-4153-b7c4-10b5be03b83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb571f1-9b18-4715-9dac-42c95c5a748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb571f1-9b18-4715-9dac-42c95c5a748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a4d6527-fced-4ce7-85c9-726045f6837c', 'volume_name': 'volume-9a4d6527-fced-4ce7-85c9-726045f6837c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab5fa62-78b9-4c28-b186-ce057db23b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab5fa62-78b9-4c28-b186-ce057db23b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f7dc7c-daf6-43c2-95e6-81fe88044536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:34 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Volume 9a4d6527-fced-4ce7-85c9-726045f6837c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a4d6527-fced-4ce7-85c9-726045f6837c', 'volume_size': 1}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2077142392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4d6527-fced-4ce7-85c9-726045f6837c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e292514b64ec46d5a7d5953c3a4b2ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:34Z,use_quota=True,user_id='33c9eecf196847d789d2762bf127ecb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Creating volume 9a4d6527-fced-4ce7-85c9-726045f6837c {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:34 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a4d6527-fced-4ce7-85c9-726045f6837c 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:34 devstack sudo[103860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a4d6527-fced-4ce7-85c9-726045f6837c 1073741824
Aug 04 09:30:34 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:34 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c" returned: 0 in 0.384s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:34 devstack sudo[103865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c
Aug 04 09:30:34 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:34 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c" returned: 0 in 0.255s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "cinder-quobyte-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c" released by "delete_volume" :: held 0.690s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:34 devstack cinder-volume[88880]: WARNING cinder.quota [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-809494504-50252615 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-809494504-50252615, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:30:34 devstack cinder-volume[88880]: WARNING cinder.quota [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-809494504-50252615 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-809494504-50252615, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Created reservations ['1b4620fe-e74b-48f0-8b69-9a1899932743', '365048fd-c846-4576-9891-b1502bed27aa', '8b00b743-7404-45d6-8272-af0d972b52be', '2a93e9d9-e66e-450a-b562-ae10a4054f15'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:34 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a4d6527-fced-4ce7-85c9-726045f6837c 1073741824" returned: 0 in 0.514s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a4d6527-fced-4ce7-85c9-726045f6837c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:34 devstack sudo[103872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a4d6527-fced-4ce7-85c9-726045f6837c
Aug 04 09:30:34 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:34 devstack sudo[103874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:34 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "cinder-4be0743b-ece3-4ef3-9024-5e8e7117f7f7-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-4be0743b-ece3-4ef3-9024-5e8e7117f7f7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:35 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a4d6527-fced-4ce7-85c9-726045f6837c" returned: 0 in 0.335s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:35 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.308s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f7dc7c-daf6-43c2-95e6-81fe88044536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a4d6527-fced-4ce7-85c9-726045f6837c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a67088-86ce-45dc-9403-0f02e3327f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:35 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Deleted volume successfully.
Aug 04 09:30:35 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Volume volume-9a4d6527-fced-4ce7-85c9-726045f6837c (9a4d6527-fced-4ce7-85c9-726045f6837c): created successfully
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a67088-86ce-45dc-9403-0f02e3327f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Flow 'volume_create_manager' (5c0d10a0-e7c8-4d65-9227-52db6519eb21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-daf8de3c-80e3-4509-b13d-d0229394dd86 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "cinder-9a8060d8-c6a8-4a81-8ea8-fc2fd9de4a4c-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "cinder-quobyte-4be0743b-ece3-4ef3-9024-5e8e7117f7f7" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:35 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a1ef9723-e184-4e78-ace1-9d998491f9d9 tempest-VolumesListAdminTestJSON-1541963730 None] Created volume successfully.
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-quobyte-4be0743b-ece3-4ef3-9024-5e8e7117f7f7" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b2f8d6-9311-40c3-9eae-282120a34972]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:35 devstack sudo[103878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7
Aug 04 09:30:35 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:35 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7" returned: 0 in 0.368s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:35 devstack sudo[103883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7
Aug 04 09:30:35 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:35 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4be0743b-ece3-4ef3-9024-5e8e7117f7f7" returned: 0 in 0.258s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-quobyte-4be0743b-ece3-4ef3-9024-5e8e7117f7f7" released by "delete_volume" :: held 0.671s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:35 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Created reservations ['2a19b90c-023a-4078-92c0-05a730f7015c', 'd6d00333-06d7-4267-bea8-b845098154be', '411bd090-4ba5-4997-85cc-83cb3b1cdf59', '023cefac-0076-4526-8654-57fe5d4635ec'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:36 devstack sudo[103892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:36 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:36 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "cinder-dd9f584a-56a4-422b-8175-8eec0008ffdb-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.281s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:36 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Deleted volume successfully.
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-dd9f584a-56a4-422b-8175-8eec0008ffdb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-90a59ada-2cb1-474c-80ab-8bb6c7d6cfb8 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-4be0743b-ece3-4ef3-9024-5e8e7117f7f7-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "cinder-quobyte-dd9f584a-56a4-422b-8175-8eec0008ffdb" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-quobyte-dd9f584a-56a4-422b-8175-8eec0008ffdb" acquired by "delete_volume" :: waited 0.014s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c596fad-69d9-4836-b014-606d0ac599e9]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dd9f584a-56a4-422b-8175-8eec0008ffdb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:36 devstack sudo[103901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dd9f584a-56a4-422b-8175-8eec0008ffdb
Aug 04 09:30:36 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Flow 'volume_create_manager' (25367f47-dded-498c-ac53-c8118c49b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e11ef80-5d3b-4a79-a419-562ae125627a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:36 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dd9f584a-56a4-422b-8175-8eec0008ffdb" returned: 0 in 0.410s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dd9f584a-56a4-422b-8175-8eec0008ffdb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e11ef80-5d3b-4a79-a419-562ae125627a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1063111781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e292514b64ec46d5a7d5953c3a4b2ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:37Z,use_quota=True,user_id='33c9eecf196847d789d2762bf127ecb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:36 devstack sudo[103914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dd9f584a-56a4-422b-8175-8eec0008ffdb
Aug 04 09:30:36 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0f1a9c-3904-46f8-8fdb-3447fd289799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0f1a9c-3904-46f8-8fdb-3447fd289799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d1c12bf-04de-4f86-b19d-4b9515b89f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d1c12bf-04de-4f86-b19d-4b9515b89f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb', 'volume_name': 'volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637deeb2-e32f-4d09-88eb-638863f46381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637deeb2-e32f-4d09-88eb-638863f46381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afd6bee-b14c-418e-8e59-d855d1d05e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:36 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Volume f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb', 'volume_size': 1}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1063111781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e292514b64ec46d5a7d5953c3a4b2ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:37Z,use_quota=True,user_id='33c9eecf196847d789d2762bf127ecb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Creating volume f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:36 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:36 devstack sudo[103916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb 1073741824
Aug 04 09:30:36 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:37 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dd9f584a-56a4-422b-8175-8eec0008ffdb" returned: 0 in 0.265s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-quobyte-dd9f584a-56a4-422b-8175-8eec0008ffdb" released by "delete_volume" :: held 0.731s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Created reservations ['7f4c5583-79c3-43a9-a846-c8a4dfc5e542', '49d3c561-8517-4cc3-b639-3124c8bc7d7f', '916f2d2f-4b6d-4bdb-800f-94e5152015ac', '27601e02-f387-459b-bc01-fcae3a34ef85'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:37 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:37 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:37 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb 1073741824" returned: 0 in 0.552s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "cinder-7fbbe07a-6194-4852-a82e-d49e45c17a29-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:37 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:37 devstack sudo[103926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.256s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:37 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Deleted volume successfully.
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-7fbbe07a-6194-4852-a82e-d49e45c17a29-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-49cd3931-078e-495c-9184-bba2138c9583 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-dd9f584a-56a4-422b-8175-8eec0008ffdb-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "cinder-quobyte-7fbbe07a-6194-4852-a82e-d49e45c17a29" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-quobyte-7fbbe07a-6194-4852-a82e-d49e45c17a29" acquired by "delete_volume" :: waited 0.014s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[01344abc-0490-4121-9e84-c21f3492ddfa]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbbe07a-6194-4852-a82e-d49e45c17a29 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:37 devstack sudo[103931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbbe07a-6194-4852-a82e-d49e45c17a29
Aug 04 09:30:37 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:37 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb" returned: 0 in 0.316s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afd6bee-b14c-418e-8e59-d855d1d05e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908332bd-3b89-4657-a13b-fd5a7e50577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:37 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Volume volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb (f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb): created successfully
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908332bd-3b89-4657-a13b-fd5a7e50577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Flow 'volume_create_manager' (25367f47-dded-498c-ac53-c8118c49b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-691efae3-19e1-4079-8693-956b02e7015d req-14e21c2d-f597-43ae-8224-7e13d5c5056a tempest-TestInstancesWithCinderVolumes-268566882 None] Terminate volume connection completed successfully.
Aug 04 09:30:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-691efae3-19e1-4079-8693-956b02e7015d req-14e21c2d-f597-43ae-8224-7e13d5c5056a tempest-TestInstancesWithCinderVolumes-268566882 None] Deleting attachment aadc23cb-8bde-4269-b320-bf6c6b9f7a7c. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:30:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-7f6c7e19-0efe-40a7-8bde-326c68b2f6e2 tempest-VolumesListAdminTestJSON-1541963730 None] Created volume successfully.
Aug 04 09:30:38 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbbe07a-6194-4852-a82e-d49e45c17a29" returned: 0 in 0.400s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbbe07a-6194-4852-a82e-d49e45c17a29 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:38 devstack sudo[103939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbbe07a-6194-4852-a82e-d49e45c17a29
Aug 04 09:30:38 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:38 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7fbbe07a-6194-4852-a82e-d49e45c17a29" returned: 0 in 0.250s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-quobyte-7fbbe07a-6194-4852-a82e-d49e45c17a29" released by "delete_volume" :: held 0.695s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "cinder-bb9a81b0-80c8-406b-a767-e05a2b454643-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "cinder-bb9a81b0-80c8-406b-a767-e05a2b454643-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Created reservations ['63074a73-91d2-445f-9157-f8f5ff415a19', '71cd5fc1-464a-4d21-ab33-25c7f96d692f', 'b8190b0b-026e-40d9-a892-4d175321e5ff', 'b239d19f-21f9-49c3-976d-7af939d49a80'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "cinder-quobyte-bb9a81b0-80c8-406b-a767-e05a2b454643" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "cinder-quobyte-bb9a81b0-80c8-406b-a767-e05a2b454643" acquired by "delete_volume" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0963a89-3e74-4387-a3b2-e3b7b9cff531]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:38 devstack sudo[103943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:38 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:38 devstack sudo[103942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643
Aug 04 09:30:38 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "cinder-456478a9-9d5b-4c3a-8c70-d2131af707ec-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-456478a9-9d5b-4c3a-8c70-d2131af707ec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "cinder-quobyte-456478a9-9d5b-4c3a-8c70-d2131af707ec" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-quobyte-456478a9-9d5b-4c3a-8c70-d2131af707ec" acquired by "delete_volume" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:38 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.333s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:38 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Deleted volume successfully.
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6781781-d2ec-459e-8f59-67c817c4d1d2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-456478a9-9d5b-4c3a-8c70-d2131af707ec {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-276e74ee-b0bd-40ae-8de4-860169e4444e tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-7fbbe07a-6194-4852-a82e-d49e45c17a29-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:39 devstack sudo[103947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-456478a9-9d5b-4c3a-8c70-d2131af707ec
Aug 04 09:30:39 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:39 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643" returned: 0 in 0.549s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:39 devstack sudo[103952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643
Aug 04 09:30:39 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:39 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bb9a81b0-80c8-406b-a767-e05a2b454643" returned: 0 in 0.303s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "cinder-quobyte-bb9a81b0-80c8-406b-a767-e05a2b454643" released by "delete_volume" :: held 0.900s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:39 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-456478a9-9d5b-4c3a-8c70-d2131af707ec" returned: 0 in 0.505s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-456478a9-9d5b-4c3a-8c70-d2131af707ec {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:39 devstack cinder-volume[88880]: WARNING cinder.quota [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-950800376-414763361 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-950800376-414763361, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:30:39 devstack cinder-volume[88880]: WARNING cinder.quota [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-950800376-414763361 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-950800376-414763361, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:30:39 devstack sudo[103959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-456478a9-9d5b-4c3a-8c70-d2131af707ec
Aug 04 09:30:39 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Created reservations ['4f0eec81-deaa-4a03-bf3b-a82d4f3da6fe', 'f29a1c7e-1822-4d7f-846f-063c0bd75f2d', 'a48315bf-1fa9-4ee4-a12f-07b9475ce3fb', '14209d9b-c3b0-449f-97a2-8435be99aeeb'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:39 devstack sudo[103961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:39 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:39 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Flow 'volume_create_manager' (02f0e452-edb8-48d4-88bb-6d17e2963145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e9d1fe-0806-4d47-9916-a0a0039743a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-456478a9-9d5b-4c3a-8c70-d2131af707ec" returned: 0 in 0.457s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e9d1fe-0806-4d47-9916-a0a0039743a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789a40dd-f1ba-422f-a2cb-948a68237fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aac305aaaaf4e499b86878127762919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:40Z,use_quota=True,user_id='8c37422c9d1747729653913a1356c541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e15d95f-b45b-4999-baee-a934c8e0940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e15d95f-b45b-4999-baee-a934c8e0940e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f476f1e4-0d0f-48d0-8fd3-271c7e6e0182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f476f1e4-0d0f-48d0-8fd3-271c7e6e0182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '789a40dd-f1ba-422f-a2cb-948a68237fa0', 'volume_name': 'volume-789a40dd-f1ba-422f-a2cb-948a68237fa0', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085a5f58-5bb0-4f82-afb7-301289d2dce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085a5f58-5bb0-4f82-afb7-301289d2dce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0f5da8-0a40-48f5-b7f8-c76838dc89b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:39 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Volume 789a40dd-f1ba-422f-a2cb-948a68237fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-789a40dd-f1ba-422f-a2cb-948a68237fa0', 'volume_size': 1}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789a40dd-f1ba-422f-a2cb-948a68237fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aac305aaaaf4e499b86878127762919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:40Z,use_quota=True,user_id='8c37422c9d1747729653913a1356c541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Creating volume 789a40dd-f1ba-422f-a2cb-948a68237fa0 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:39 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-789a40dd-f1ba-422f-a2cb-948a68237fa0 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-quobyte-456478a9-9d5b-4c3a-8c70-d2131af707ec" released by "delete_volume" :: held 1.132s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:39 devstack sudo[103967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-789a40dd-f1ba-422f-a2cb-948a68237fa0 1073741824
Aug 04 09:30:39 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:39 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.388s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:40 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Deleted volume successfully.
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-39e4cc6d-76ae-4c9d-8b34-cdfe01a475e5 tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "cinder-bb9a81b0-80c8-406b-a767-e05a2b454643-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Created reservations ['8dd46e92-dfc0-45f8-a968-5ca76191cad1', 'f809086a-863d-44d4-bdf7-2b02932fbdc4', '39559682-adc5-43a2-b606-254a405ebeb3', 'd9d87fa6-0fd6-48bb-b5c1-e88ab179cdc4'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:40 devstack sudo[103969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:40 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:40 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.386s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:40 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:40 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Deleted volume successfully.
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-789a40dd-f1ba-422f-a2cb-948a68237fa0 1073741824" returned: 0 in 0.655s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9ceea8c7-bb6e-4d6f-9fb4-aebd39e377bd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-456478a9-9d5b-4c3a-8c70-d2131af707ec-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-789a40dd-f1ba-422f-a2cb-948a68237fa0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:40 devstack sudo[103975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-789a40dd-f1ba-422f-a2cb-948a68237fa0
Aug 04 09:30:40 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:40 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-789a40dd-f1ba-422f-a2cb-948a68237fa0" returned: 0 in 0.267s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0f5da8-0a40-48f5-b7f8-c76838dc89b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789a40dd-f1ba-422f-a2cb-948a68237fa0', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f27e554-1ffc-455f-969a-e360fed94ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:40 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Volume volume-789a40dd-f1ba-422f-a2cb-948a68237fa0 (789a40dd-f1ba-422f-a2cb-948a68237fa0): created successfully
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f27e554-1ffc-455f-969a-e360fed94ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Flow 'volume_create_manager' (02f0e452-edb8-48d4-88bb-6d17e2963145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:40 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-dc353d68-7277-46db-b874-c54426c254a9 tempest-VolumesListAdminTestJSON-1710780377 None] Created volume successfully.
Aug 04 09:30:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "cinder-425564e4-435e-466a-9b39-4d2e95768828-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-425564e4-435e-466a-9b39-4d2e95768828-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "cinder-quobyte-425564e4-435e-466a-9b39-4d2e95768828" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-quobyte-425564e4-435e-466a-9b39-4d2e95768828" acquired by "delete_volume" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:41 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdccbf7-65a5-4920-88cf-31529ae2a8e5]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-425564e4-435e-466a-9b39-4d2e95768828 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:41 devstack sudo[103978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-425564e4-435e-466a-9b39-4d2e95768828
Aug 04 09:30:41 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:41 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-425564e4-435e-466a-9b39-4d2e95768828" returned: 0 in 0.484s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-425564e4-435e-466a-9b39-4d2e95768828 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:41 devstack sudo[103986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-425564e4-435e-466a-9b39-4d2e95768828
Aug 04 09:30:41 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:41 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-425564e4-435e-466a-9b39-4d2e95768828" returned: 0 in 0.296s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-quobyte-425564e4-435e-466a-9b39-4d2e95768828" released by "delete_volume" :: held 0.832s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Acquiring lock "cinder-789a40dd-f1ba-422f-a2cb-948a68237fa0-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Lock "cinder-789a40dd-f1ba-422f-a2cb-948a68237fa0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Created reservations ['83579a15-dc25-4a48-9c6e-9d988f7551ed', '4b834770-ff52-49f8-baa2-bd3d06e240af', '1c669d69-39e6-4c03-9608-36183f4a0749', '822fc38e-a682-4607-b4a6-a9cf86094ab6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Acquiring lock "cinder-quobyte-789a40dd-f1ba-422f-a2cb-948a68237fa0" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Lock "cinder-quobyte-789a40dd-f1ba-422f-a2cb-948a68237fa0" acquired by "delete_volume" :: waited 0.046s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c256b9a-864d-4024-b19c-3706a6e24ef6]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-789a40dd-f1ba-422f-a2cb-948a68237fa0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "cinder-538f649f-f892-456a-8eca-8747fd9a2473-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "cinder-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:42 devstack sudo[104048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:42 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-538f649f-f892-456a-8eca-8747fd9a2473-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "cinder-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "cinder-quobyte-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:42 devstack sudo[104041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-789a40dd-f1ba-422f-a2cb-948a68237fa0
Aug 04 09:30:42 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "cinder-quobyte-538f649f-f892-456a-8eca-8747fd9a2473" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "cinder-quobyte-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb" acquired by "delete_volume" :: waited 0.043s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[847e8f92-14bc-4d1e-9be5-8114774e9dab]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-quobyte-538f649f-f892-456a-8eca-8747fd9a2473" acquired by "delete_volume" :: waited 0.075s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7e003d-31f0-4244-8a39-feff11a64cc7]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-538f649f-f892-456a-8eca-8747fd9a2473 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:42 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.458s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:42 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Deleted volume successfully.
Aug 04 09:30:42 devstack sudo[104054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb
Aug 04 09:30:42 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-eae005e0-a011-45de-b099-5cb6a1f2a686 tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-425564e4-435e-466a-9b39-4d2e95768828-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:42 devstack sudo[104055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-538f649f-f892-456a-8eca-8747fd9a2473
Aug 04 09:30:42 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:43 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-789a40dd-f1ba-422f-a2cb-948a68237fa0" returned: 0 in 0.785s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-789a40dd-f1ba-422f-a2cb-948a68237fa0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:43 devstack sudo[104062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-789a40dd-f1ba-422f-a2cb-948a68237fa0
Aug 04 09:30:43 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:43 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb" returned: 0 in 0.636s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:43 devstack sudo[104070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb
Aug 04 09:30:43 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:43 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-538f649f-f892-456a-8eca-8747fd9a2473" returned: 0 in 0.626s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-538f649f-f892-456a-8eca-8747fd9a2473 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:43 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:43 devstack sudo[104073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-538f649f-f892-456a-8eca-8747fd9a2473
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-789a40dd-f1ba-422f-a2cb-948a68237fa0" returned: 0 in 0.330s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:43 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Lock "cinder-quobyte-789a40dd-f1ba-422f-a2cb-948a68237fa0" released by "delete_volume" :: held 1.232s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Created reservations ['48b6b04f-1d4b-4794-ab19-b5f99eb26fe1', '4616b414-2a29-4f56-a81c-a0e78f95955c', '34628b82-dfeb-4eb9-be71-4f8d3e89d42b', 'd3896b85-c1fa-4db1-8859-a34a938ac4a2'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:43 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb" returned: 0 in 0.405s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:43 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-538f649f-f892-456a-8eca-8747fd9a2473" returned: 0 in 0.352s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:43 devstack sudo[104078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:43 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "cinder-quobyte-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb" released by "delete_volume" :: held 1.123s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-quobyte-538f649f-f892-456a-8eca-8747fd9a2473" released by "delete_volume" :: held 1.080s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Created reservations ['56f416e9-6247-45b8-a644-6b7a0e412481', '8bbd3cdf-43c2-44f4-b9e6-698d28a1c252', 'a0b35d31-7285-4d6d-9809-d24201c86c6b', '1f186cd4-2453-4b45-8fea-0a354917ea85'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Created reservations ['9057c90d-3a4b-4c31-b059-0746b711b5b1', 'e1f65e62-307e-4327-8588-4be817a35829', 'fca13823-c0bb-46a8-a11e-11d9921612d4', '70a4dad0-0a39-4b6e-9dd7-8eb5a32d9e76'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:44 devstack sudo[104082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:44 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:44 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-ffe39a2e-cd5d-49cc-a066-33d7fca189a5 req-307a9f6b-7ada-4a70-ae76-3da06e517adc tempest-TestInstancesWithCinderVolumes-268566882 None] Terminate volume connection completed successfully.
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-ffe39a2e-cd5d-49cc-a066-33d7fca189a5 req-307a9f6b-7ada-4a70-ae76-3da06e517adc tempest-TestInstancesWithCinderVolumes-268566882 None] Deleting attachment af65ba6f-e9da-4411-bd57-7770294fe554. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.338s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Deleted volume successfully.
Aug 04 09:30:44 devstack sudo[104084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:44 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bbee95-a486-452c-9b21-7c4d6509893b tempest-VolumesListAdminTestJSON-1710780377 None] Lock "cinder-789a40dd-f1ba-422f-a2cb-948a68237fa0-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:44 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.293s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Deleted volume successfully.
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-48d033f0-b91e-4def-9f4e-a51823c0c9d7 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "cinder-f4946b39-4a4d-41b5-b4ad-be2e3d15eeeb-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:44 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.334s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Deleted volume successfully.
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c99d09b6-0708-49e6-b34f-536c6bea5cbd tempest-CreateVolumesFromSourceVolumeTest-206031868 None] Lock "cinder-538f649f-f892-456a-8eca-8747fd9a2473-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "cinder-9a4d6527-fced-4ce7-85c9-726045f6837c-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "cinder-9a4d6527-fced-4ce7-85c9-726045f6837c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "cinder-quobyte-9a4d6527-fced-4ce7-85c9-726045f6837c" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "cinder-quobyte-9a4d6527-fced-4ce7-85c9-726045f6837c" acquired by "delete_volume" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[742c77e6-c6b5-4585-9d59-747788857c8d]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a4d6527-fced-4ce7-85c9-726045f6837c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:45 devstack sudo[104088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a4d6527-fced-4ce7-85c9-726045f6837c
Aug 04 09:30:45 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:45 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a4d6527-fced-4ce7-85c9-726045f6837c" returned: 0 in 0.382s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a4d6527-fced-4ce7-85c9-726045f6837c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:45 devstack sudo[104094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a4d6527-fced-4ce7-85c9-726045f6837c
Aug 04 09:30:45 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "cinder-c19b6e2b-83a0-43df-9684-8e03ee24dc85-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "cinder-c19b6e2b-83a0-43df-9684-8e03ee24dc85-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "cinder-quobyte-c19b6e2b-83a0-43df-9684-8e03ee24dc85" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "cinder-quobyte-c19b6e2b-83a0-43df-9684-8e03ee24dc85" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:45 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9a4d6527-fced-4ce7-85c9-726045f6837c" returned: 0 in 0.339s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "cinder-quobyte-9a4d6527-fced-4ce7-85c9-726045f6837c" released by "delete_volume" :: held 0.766s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c8560f-d611-42b0-b335-d0d9496f099b]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Created reservations ['75d56aa3-69fc-4b64-8513-7beb9d74ac0e', '1173fba3-49b5-4ac6-85c8-586e6d14d9ef', '4cceedfd-ffc0-4f45-b5a1-d743f0221004', '1495730e-c899-4614-b4df-7d7d4f589eb7'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:45 devstack sudo[104097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85
Aug 04 09:30:45 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:45 devstack sudo[104099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:45 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:46 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85" returned: 0 in 0.400s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "cinder-63fcdf08-20c0-435c-ba01-d5403f211be4-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Lock "cinder-63fcdf08-20c0-435c-ba01-d5403f211be4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "cinder-quobyte-63fcdf08-20c0-435c-ba01-d5403f211be4" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Lock "cinder-quobyte-63fcdf08-20c0-435c-ba01-d5403f211be4" acquired by "delete_volume" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:46 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.429s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:46 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Deleted volume successfully.
Aug 04 09:30:46 devstack sudo[104103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85
Aug 04 09:30:46 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[220ff232-3b4d-40a9-b337-0f24985343b0]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-63fcdf08-20c0-435c-ba01-d5403f211be4 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-90fb888d-f856-4e0d-961e-7b1aa5bd9395 tempest-VolumesListAdminTestJSON-1541963730 None] Lock "cinder-9a4d6527-fced-4ce7-85c9-726045f6837c-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:46 devstack sudo[104106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-63fcdf08-20c0-435c-ba01-d5403f211be4
Aug 04 09:30:46 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:46 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85" returned: 1 in 0.477s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:46 devstack sudo[104111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85
Aug 04 09:30:46 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:46 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-63fcdf08-20c0-435c-ba01-d5403f211be4" returned: 0 in 0.450s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-63fcdf08-20c0-435c-ba01-d5403f211be4 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:46 devstack sudo[104116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-63fcdf08-20c0-435c-ba01-d5403f211be4
Aug 04 09:30:46 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:46 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c19b6e2b-83a0-43df-9684-8e03ee24dc85" returned: 0 in 0.271s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "cinder-quobyte-c19b6e2b-83a0-43df-9684-8e03ee24dc85" released by "delete_volume" :: held 1.233s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:46 devstack cinder-volume[88880]: WARNING cinder.quota [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-713268654-814286441 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-713268654-814286441, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:30:46 devstack cinder-volume[88880]: WARNING cinder.quota [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-713268654-814286441 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-713268654-814286441, it is now deprecated. Please use the default quota class for default quota.
Aug 04 09:30:46 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Created reservations ['6b667104-7e42-46dc-8833-099e852d7bea', '5078b281-b5a3-4f5b-b1a1-7de289510216', '14641ed9-f6c1-48e9-95db-577313d7b929', 'bd958fdd-61ce-4b4d-aab3-86f240e909dd'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:47 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-63fcdf08-20c0-435c-ba01-d5403f211be4" returned: 0 in 0.278s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:47 devstack sudo[104120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:47 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Lock "cinder-quobyte-63fcdf08-20c0-435c-ba01-d5403f211be4" released by "delete_volume" :: held 0.799s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Created reservations ['6aadcdee-c696-4569-94c2-9e84fa6cfc3a', '13ece51a-6e61-4678-b783-658e46d5dd52', '51411f1e-dd03-423c-ba02-13e8c5d3a2e8', '9e1de4ee-6679-43dd-aa15-836b955356ce'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:47 devstack sudo[104122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:30:47 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:47 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.273s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:47 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Deleted volume successfully.
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-059b1f47-1263-4578-9f39-089767a01cad tempest-TestInstancesWithCinderVolumes-268566882 None] Lock "cinder-c19b6e2b-83a0-43df-9684-8e03ee24dc85-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:47 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.278s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:30:47 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Deleted volume successfully.
Aug 04 09:30:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-505101d7-67d2-4e8a-8491-1b0e32ee219f tempest-VolumesListAdminTestJSON-1541963730 None] Lock "cinder-63fcdf08-20c0-435c-ba01-d5403f211be4-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:30:51 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Flow 'volume_create_manager' (71a5f3e7-a68b-4870-b645-2740372210d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9cfcd33-3f39-4cef-ab7a-c7766cc183d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9cfcd33-3f39-4cef-ab7a-c7766cc183d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a98801-9f21-42ea-bf44-b3db84e60e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35cbdb5d6f0b43f5ab91b027eb7ae712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:52Z,use_quota=True,user_id='1e83e0df2dae41ee916824eaef406e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f67a46-872c-4037-8263-abc5fe6e2396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f67a46-872c-4037-8263-abc5fe6e2396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9450c7fa-742c-4ce3-8f20-6ecc9cec2ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:51 devstack cinder-volume[88880]: DEBUG cinder.image.glance [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Creating Keystone auth plugin from conf {{(pid=88880) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 04 09:30:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9450c7fa-742c-4ce3-8f20-6ecc9cec2ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01a98801-9f21-42ea-bf44-b3db84e60e09', 'volume_name': 'volume-01a98801-9f21-42ea-bf44-b3db84e60e09', 'volume_size': 1, 'image_id': '8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '665d5c7e63e5fcbddd512e1355f3381d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35cbdb5d6f0b43f5ab91b027eb7ae712', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3a970fd910a23974f3e229ca5c96c68cfee810b7a2d649a8a7e0abeb74d85a9b265387124b341cd8aa31da8bbe6bfb9414f8a4aa317a85f29d25a76355d8c82', 'id': '8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'created_at': datetime.datetime(2026, 8, 4, 7, 30, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 30, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dafc721b0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ee0a40-beaa-42af-a62f-e904c4a7ac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ee0a40-beaa-42af-a62f-e904c4a7ac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:52 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521daada-9967-4c2c-bd3b-e15c62b920d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:52 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Volume 01a98801-9f21-42ea-bf44-b3db84e60e09: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01a98801-9f21-42ea-bf44-b3db84e60e09', 'volume_size': 1, 'image_id': '8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '665d5c7e63e5fcbddd512e1355f3381d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35cbdb5d6f0b43f5ab91b027eb7ae712', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3a970fd910a23974f3e229ca5c96c68cfee810b7a2d649a8a7e0abeb74d85a9b265387124b341cd8aa31da8bbe6bfb9414f8a4aa317a85f29d25a76355d8c82', 'id': '8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'created_at': datetime.datetime(2026, 8, 4, 7, 30, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 30, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dafc721b0>}
Aug 04 09:30:52 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Trying to clone 01a98801-9f21-42ea-bf44-b3db84e60e09 from image 8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'metadata': {}}]). {{(pid=88880) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 04 09:30:52 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 04 09:30:52 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Image download 0.00 MB at 0.00 MB/s
Aug 04 09:30:52 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda4a182-465b-4dcf-8065-7f6ff5419802]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:52 devstack sudo[104131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD
Aug 04 09:30:52 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:52 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:52 devstack sudo[104141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD
Aug 04 09:30:52 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:53 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD" returned: 1 in 0.412s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Temporary image 8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf is fetched for user 1e83e0df2dae41ee916824eaef406e97. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd9beac-84d6-4881-9170-bd7fc126278d]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:53 devstack sudo[104146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD
Aug 04 09:30:53 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:53 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:53 devstack sudo[104151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD
Aug 04 09:30:53 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:53 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a98801-9f21-42ea-bf44-b3db84e60e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35cbdb5d6f0b43f5ab91b027eb7ae712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:52Z,use_quota=True,user_id='1e83e0df2dae41ee916824eaef406e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Creating volume 01a98801-9f21-42ea-bf44-b3db84e60e09 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:53 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:53 devstack sudo[104156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 1073741824
Aug 04 09:30:53 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:54 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 1073741824" returned: 0 in 0.536s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:54 devstack sudo[104162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09
Aug 04 09:30:54 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:54 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09" returned: 0 in 0.246s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Attempting download of 8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf ((None, [{'url': 'file:///opt/stack/data/glance/images/8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'metadata': {}}])) to volume 01a98801-9f21-42ea-bf44-b3db84e60e09. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf1d571-afd0-4a64-9237-1e1359bc3823]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_s6puvmfx {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:55 devstack sudo[104166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_s6puvmfx
Aug 04 09:30:55 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Flow 'volume_create_manager' (2bd3ae2d-03b6-4410-8964-0f1f0e108c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecc89c1-3db3-47d5-bf0b-aafdac1af2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecc89c1-3db3-47d5-bf0b-aafdac1af2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1515962853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f83a0e3-3e42-4ec3-9434-ab81e87d7db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044d45bbd96c4b5fa1d864ef43cd0457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:56Z,use_quota=True,user_id='85c522fc082540f6baf52bcb74e4608d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d36b5c-ae3c-4a96-8521-d43ce52112c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d36b5c-ae3c-4a96-8521-d43ce52112c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2489f63-7116-450b-9b1b-e7aac42b85d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2489f63-7116-450b-9b1b-e7aac42b85d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f83a0e3-3e42-4ec3-9434-ab81e87d7db7', 'volume_name': 'volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369af299-6e69-40b8-b526-2ce557b3036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:55 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369af299-6e69-40b8-b526-2ce557b3036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1840fd0d-e181-4a77-bbbe-b8a6ca3b30c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:55 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Volume 2f83a0e3-3e42-4ec3-9434-ab81e87d7db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7', 'volume_size': 1}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1515962853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f83a0e3-3e42-4ec3-9434-ab81e87d7db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044d45bbd96c4b5fa1d864ef43cd0457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:30:56Z,use_quota=True,user_id='85c522fc082540f6baf52bcb74e4608d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Creating volume 2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:30:55 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_s6puvmfx" returned: 0 in 0.423s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_s6puvmfx {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:55 devstack sudo[104170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 1073741824
Aug 04 09:30:55 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:55 devstack sudo[104171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_s6puvmfx
Aug 04 09:30:55 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:56 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_s6puvmfx" returned: 1 in 0.342s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_s6puvmfx' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4bb23d-71bc-4903-9c66-80a39ca9e63e]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:56 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 1073741824" returned: 0 in 0.488s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=171,cinder:INSERT=51,cinder:UPDATE=235,cinder:DELETE=14 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:30:56 devstack sudo[104179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD
Aug 04 09:30:56 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:56 devstack sudo[104181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7
Aug 04 09:30:56 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:56 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:56 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7" returned: 0 in 0.271s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1840fd0d-e181-4a77-bbbe-b8a6ca3b30c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640ca3ea-f0ba-4114-bc7f-c0afa71bc31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:56 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Volume volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 (2f83a0e3-3e42-4ec3-9434-ab81e87d7db7): created successfully
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640ca3ea-f0ba-4114-bc7f-c0afa71bc31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Flow 'volume_create_manager' (2bd3ae2d-03b6-4410-8964-0f1f0e108c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:56 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-54f8810d-1c86-4786-8097-fadc53df3215 tempest-SnapshotMetadataTestJSON-1833176810 None] Created volume successfully.
Aug 04 09:30:56 devstack sudo[104186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD
Aug 04 09:30:56 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:56 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] 8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf was raw, converting to raw {{(pid=88880) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 04 09:30:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:56 devstack sudo[104191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09
Aug 04 09:30:56 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:57 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09" returned: 0 in 0.416s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf_sc3fjsvhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:30:57 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Converted 0.00 MB image at 0.00 MB/s
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:57 devstack sudo[104196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 1G
Aug 04 09:30:57 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:57 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 1G" returned: 0 in 0.307s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbbe773-69b7-4109-aea8-5c13f8941a7e]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:57 devstack sudo[104201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09
Aug 04 09:30:57 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] Creating offline snapshot 4f8abe29-d377-4721-b668-7b518440ae09 of volume 2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd4deff-ddd8-4fdd-8e4e-1032b5d10101]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:57 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09" returned: 0 in 0.419s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:58 devstack sudo[104205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7
Aug 04 09:30:58 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:58 devstack sudo[104206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09
Aug 04 09:30:58 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:58 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7" returned: 0 in 0.428s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:58 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09" returned: 1 in 0.397s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Downloaded image 8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf ((None, [{'url': 'file:///opt/stack/data/glance/images/8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'metadata': {}}])) to volume 01a98801-9f21-42ea-bf44-b3db84e60e09 successfully. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Temporary image 8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf for user 1e83e0df2dae41ee916824eaef406e97 is deleted. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Marking volume 01a98801-9f21-42ea-bf44-b3db84e60e09 as bootable. {{(pid=88880) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 04 09:30:58 devstack sudo[104216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09 1G
Aug 04 09:30:58 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Copying metadata from image 8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf to 01a98801-9f21-42ea-bf44-b3db84e60e09. {{(pid=88880) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Creating volume glance metadata for volume 01a98801-9f21-42ea-bf44-b3db84e60e09 backed by image 8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf with: {'image_id': '8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '665d5c7e63e5fcbddd512e1355f3381d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88880) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521daada-9967-4c2c-bd3b-e15c62b920d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a98801-9f21-42ea-bf44-b3db84e60e09', 'volume_size': 1, 'image_id': '8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '665d5c7e63e5fcbddd512e1355f3381d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35cbdb5d6f0b43f5ab91b027eb7ae712', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3a970fd910a23974f3e229ca5c96c68cfee810b7a2d649a8a7e0abeb74d85a9b265387124b341cd8aa31da8bbe6bfb9414f8a4aa317a85f29d25a76355d8c82', 'id': '8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf', 'created_at': datetime.datetime(2026, 8, 4, 7, 30, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 30, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a96b9ee-6b0c-4d4d-86de-6e6c5d1935cf/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dafc721b0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae46a6ef-0148-4623-a702-a5c73804dde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:30:58 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Volume volume-01a98801-9f21-42ea-bf44-b3db84e60e09 (01a98801-9f21-42ea-bf44-b3db84e60e09): created successfully
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae46a6ef-0148-4623-a702-a5c73804dde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Flow 'volume_create_manager' (71a5f3e7-a68b-4870-b645-2740372210d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:30:58 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6b9cb26a-87fc-48ad-a658-133a1349206b tempest-VolumeImageDependencyTests-2095460315 None] Created volume successfully.
Aug 04 09:30:58 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09 1G" returned: 0 in 0.436s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:58 devstack sudo[104222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09
Aug 04 09:30:58 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:59 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Acquiring lock "cinder-01a98801-9f21-42ea-bf44-b3db84e60e09-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09" returned: 0 in 0.325s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:59 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09 is being set with open permissions: ugo+rw
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:59 devstack sudo[104227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09
Aug 04 09:30:59 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Lock "cinder-01a98801-9f21-42ea-bf44-b3db84e60e09-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Acquiring lock "cinder-quobyte-01a98801-9f21-42ea-bf44-b3db84e60e09" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Lock "cinder-quobyte-01a98801-9f21-42ea-bf44-b3db84e60e09" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78c089d-cc17-4b15-98d5-780c59cd0b8d]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:59 devstack sudo[104229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09
Aug 04 09:30:59 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:59 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09" returned: 0 in 0.272s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:59 devstack sudo[104232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.info
Aug 04 09:30:59 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:59 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09" returned: 0 in 0.366s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:59 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.info" returned: 0 in 0.278s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:59 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.info is being set with open permissions: ugo+rw
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:30:59 devstack sudo[104239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.info
Aug 04 09:30:59 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:59 devstack sudo[104236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09
Aug 04 09:30:59 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:30:59 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.info" returned: 0 in 0.264s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:30:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.092s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:00 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-fb6b2896-770e-4e85-8953-b0a93dfcbe57 tempest-SnapshotMetadataTestJSON-1833176810 None] Create snapshot completed successfully
Aug 04 09:31:00 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09" returned: 1 in 0.393s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:00 devstack sudo[104246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09
Aug 04 09:31:00 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:00 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-01a98801-9f21-42ea-bf44-b3db84e60e09" returned: 0 in 0.265s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Lock "cinder-quobyte-01a98801-9f21-42ea-bf44-b3db84e60e09" released by "delete_volume" :: held 1.093s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Created reservations ['afc60896-6844-403b-9ca3-d25904460368', '3d9e4833-a722-4030-8f17-910b57e74c35', 'b079c0b7-9d01-4e65-bf7d-02ba8dfb1e22', '84548bc0-fa51-4f46-8786-585194867f28'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:00 devstack sudo[104249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:31:00 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:00 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.238s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:31:00 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Deleted volume successfully.
Aug 04 09:31:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2f01d1ed-f256-45d7-bed4-8192018f3f32 tempest-VolumeImageDependencyTests-2095460315 None] Lock "cinder-01a98801-9f21-42ea-bf44-b3db84e60e09-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Acquiring lock "cinder-4f8abe29-d377-4721-b668-7b518440ae09-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "cinder-4f8abe29-d377-4721-b668-7b518440ae09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Acquiring lock "cinder-quobyte-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "cinder-quobyte-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Acquiring lock "cinder-quobyte-4f8abe29-d377-4721-b668-7b518440ae09" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "cinder-quobyte-4f8abe29-d377-4721-b668-7b518440ae09" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Deleting offline snapshot 4f8abe29-d377-4721-b668-7b518440ae09 of volume 2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:31:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] snapshot_file for this snap is: volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:31:01 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6754e17d-576f-49a8-b994-c00a335de2ea]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:01 devstack sudo[104252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09
Aug 04 09:31:01 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:02 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09" returned: 0 in 0.447s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:02 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:31:02 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eb9f39-1ce4-4d80-a369-1ad84a82880a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:02 devstack sudo[104258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7
Aug 04 09:31:02 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:02 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7" returned: 0 in 0.506s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:02 devstack sudo[104263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09
Aug 04 09:31:02 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:03 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09" returned: 0 in 0.451s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:03 devstack sudo[104270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09
Aug 04 09:31:03 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:03 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7.4f8abe29-d377-4721-b668-7b518440ae09" returned: 0 in 0.284s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "cinder-quobyte-4f8abe29-d377-4721-b668-7b518440ae09" released by "_delete_snapshot" :: held 1.859s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "cinder-quobyte-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7" released by "delete_snapshot" :: held 1.896s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:03 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Created reservations ['1492b693-0019-4761-8364-e2ca37d032db', 'b9019392-be19-4c91-ab54-4b43e34a9c9c', 'b7269ecf-4f5d-48c3-a005-16153c45c4c6', '43da4581-bfbc-485d-b6a5-5722be97365d'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:31:03 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Delete snapshot completed successfully.
Aug 04 09:31:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8f2fd7bc-7726-4d1e-9bcd-248e98d9800e tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "cinder-4f8abe29-d377-4721-b668-7b518440ae09-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Acquiring lock "cinder-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "cinder-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Acquiring lock "cinder-quobyte-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "cinder-quobyte-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:04 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b024c87-11fc-46db-989a-48d117e45754]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:04 devstack sudo[104273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7
Aug 04 09:31:04 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:04 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7" returned: 0 in 0.439s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:04 devstack sudo[104278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7
Aug 04 09:31:04 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:04 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7" returned: 0 in 0.284s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "cinder-quobyte-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7" released by "delete_volume" :: held 0.805s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Created reservations ['bad59213-e5f3-4f4d-99ce-eb7fd7cf76ed', '9fec642a-79ba-47ee-a35c-a7ed5784a35c', '7ee5a6d5-db30-4861-84ae-fd0b0d30b210', '312e8d05-887a-4724-9c54-48e483f973bd'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Flow 'volume_create_manager' (068d2c59-30f3-4cfd-8ee7-f0ed0bd96464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bfbfcd-ec56-4c9f-83c5-865ca1c30e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bfbfcd-ec56-4c9f-83c5-865ca1c30e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c57e803-d670-4745-ad95-999037885310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25684a9f3fa4a52b6f52ce9f8bdf05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:05Z,use_quota=True,user_id='a34b488bb8554079aaf9ee2a65f5446c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:05 devstack sudo[104281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:31:05 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd03285c-3fb9-4c74-b9c4-7483434f197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd03285c-3fb9-4c74-b9c4-7483434f197c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8228d809-a3cc-4d7d-81ba-9f9db857d4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8228d809-a3cc-4d7d-81ba-9f9db857d4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c57e803-d670-4745-ad95-999037885310', 'volume_name': 'volume-1c57e803-d670-4745-ad95-999037885310', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94dd9329-0576-45d5-baa1-1495c937267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94dd9329-0576-45d5-baa1-1495c937267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4e6ca0-282b-4617-b07a-4ad706269329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:05 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Volume 1c57e803-d670-4745-ad95-999037885310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c57e803-d670-4745-ad95-999037885310', 'volume_size': 1}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c57e803-d670-4745-ad95-999037885310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25684a9f3fa4a52b6f52ce9f8bdf05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:05Z,use_quota=True,user_id='a34b488bb8554079aaf9ee2a65f5446c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Creating volume 1c57e803-d670-4745-ad95-999037885310 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:31:05 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c57e803-d670-4745-ad95-999037885310 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:05 devstack sudo[104283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c57e803-d670-4745-ad95-999037885310 1073741824
Aug 04 09:31:05 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:05 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.309s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:31:05 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Deleted volume successfully.
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9f5665bf-3f4a-4035-83be-0e1a060b67e1 tempest-SnapshotMetadataTestJSON-1833176810 None] Lock "cinder-2f83a0e3-3e42-4ec3-9434-ab81e87d7db7-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:05 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c57e803-d670-4745-ad95-999037885310 1073741824" returned: 0 in 0.519s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c57e803-d670-4745-ad95-999037885310 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:05 devstack sudo[104290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c57e803-d670-4745-ad95-999037885310
Aug 04 09:31:05 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:06 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c57e803-d670-4745-ad95-999037885310" returned: 0 in 0.285s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:31:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:06 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4e6ca0-282b-4617-b07a-4ad706269329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c57e803-d670-4745-ad95-999037885310', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:06 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc90c39-f2a8-4488-9523-439909fd2ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:06 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Volume volume-1c57e803-d670-4745-ad95-999037885310 (1c57e803-d670-4745-ad95-999037885310): created successfully
Aug 04 09:31:06 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc90c39-f2a8-4488-9523-439909fd2ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:06 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Flow 'volume_create_manager' (068d2c59-30f3-4cfd-8ee7-f0ed0bd96464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:06 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4316e829-b84c-486e-8960-1641e0f3bf3c tempest-CinderUnicodeTest-1041556285 None] Created volume successfully.
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=242,cinder:SELECT=173,cinder:INSERT=62,cinder:DELETE=23 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Flow 'volume_create_manager' (e0c6fc5a-f6bd-4a66-8efb-5076813f4787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b088395d-e101-4481-82b4-5605fe8d7061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b088395d-e101-4481-82b4-5605fe8d7061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2099752644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2be6e0-6437-4313-9051-ea48cede45b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25684a9f3fa4a52b6f52ce9f8bdf05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:08Z,use_quota=True,user_id='a34b488bb8554079aaf9ee2a65f5446c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ae39c6-2ac6-41d7-9a6a-c513e8d6f03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ae39c6-2ac6-41d7-9a6a-c513e8d6f03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb9d8fc-1832-4ac2-9330-cc8732a0099e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb9d8fc-1832-4ac2-9330-cc8732a0099e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b2be6e0-6437-4313-9051-ea48cede45b5', 'volume_name': 'volume-2b2be6e0-6437-4313-9051-ea48cede45b5', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c09822-59fd-4d23-ae7a-cd5faea7fb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c09822-59fd-4d23-ae7a-cd5faea7fb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620ee307-1409-49ba-804e-fb55e49ae633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:07 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Volume 2b2be6e0-6437-4313-9051-ea48cede45b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b2be6e0-6437-4313-9051-ea48cede45b5', 'volume_size': 1}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2099752644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2be6e0-6437-4313-9051-ea48cede45b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25684a9f3fa4a52b6f52ce9f8bdf05e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:08Z,use_quota=True,user_id='a34b488bb8554079aaf9ee2a65f5446c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Creating volume 2b2be6e0-6437-4313-9051-ea48cede45b5 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:31:07 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:31:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:07 devstack sudo[104293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5 1073741824
Aug 04 09:31:07 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:08 devstack sudo[104295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:31:08 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:08 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.462s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:31:08 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5 1073741824" returned: 0 in 0.760s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:08 devstack sudo[104301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5
Aug 04 09:31:08 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:09 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5" returned: 0 in 0.308s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:31:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620ee307-1409-49ba-804e-fb55e49ae633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b2be6e0-6437-4313-9051-ea48cede45b5', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d483fb-733f-4ec7-b40a-81433e7c9918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:09 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Volume volume-2b2be6e0-6437-4313-9051-ea48cede45b5 (2b2be6e0-6437-4313-9051-ea48cede45b5): created successfully
Aug 04 09:31:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d483fb-733f-4ec7-b40a-81433e7c9918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Flow 'volume_create_manager' (e0c6fc5a-f6bd-4a66-8efb-5076813f4787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:09 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-88ab634c-4070-4dee-9091-f713a51cd409 tempest-CinderUnicodeTest-1041556285 None] Created volume successfully.
Aug 04 09:31:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] Creating offline snapshot b041cc52-eee4-41cd-b424-ae93f5013f66 of volume 2b2be6e0-6437-4313-9051-ea48cede45b5 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:31:10 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9c9cf2-fa4c-4ad3-a8ca-90686d61a348]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:10 devstack sudo[104305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5
Aug 04 09:31:10 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:10 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5" returned: 0 in 0.416s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:10 devstack sudo[104310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66 1G
Aug 04 09:31:10 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:11 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66 1G" returned: 0 in 0.464s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b2be6e0-6437-4313-9051-ea48cede45b5 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:11 devstack sudo[104317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b2be6e0-6437-4313-9051-ea48cede45b5 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66
Aug 04 09:31:11 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:11 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b2be6e0-6437-4313-9051-ea48cede45b5 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66" returned: 0 in 0.470s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:11 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66 is being set with open permissions: ugo+rw
Aug 04 09:31:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:11 devstack sudo[104323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66
Aug 04 09:31:11 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:11 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66" returned: 0 in 0.311s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:11 devstack sudo[104326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.info
Aug 04 09:31:11 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:12 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.info" returned: 0 in 0.294s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:12 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.info is being set with open permissions: ugo+rw
Aug 04 09:31:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:12 devstack sudo[104329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.info
Aug 04 09:31:12 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:12 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.info" returned: 0 in 0.260s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.345s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:12 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6ded6263-34b8-4255-95c0-84de342712ae tempest-CinderUnicodeTest-1041556285 None] Create snapshot completed successfully
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "cinder-b041cc52-eee4-41cd-b424-ae93f5013f66-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-b041cc52-eee4-41cd-b424-ae93f5013f66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "cinder-quobyte-2b2be6e0-6437-4313-9051-ea48cede45b5" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-quobyte-2b2be6e0-6437-4313-9051-ea48cede45b5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "cinder-quobyte-b041cc52-eee4-41cd-b424-ae93f5013f66" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-quobyte-b041cc52-eee4-41cd-b424-ae93f5013f66" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Deleting offline snapshot b041cc52-eee4-41cd-b424-ae93f5013f66 of volume 2b2be6e0-6437-4313-9051-ea48cede45b5 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] snapshot_file for this snap is: volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a16780a-6aaf-4dd6-9f99-f4fc3b4b83d5]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:13 devstack sudo[104332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66
Aug 04 09:31:13 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Flow 'volume_create_manager' (05d59036-9206-4154-bf9c-b77c83886462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51aef244-1e3f-465d-a5a9-384a3264b2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51aef244-1e3f-465d-a5a9-384a3264b2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1838113767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb229a8-3a97-4a83-a979-09c32c2d3925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c677e1a59f74475d94f48e1f586c7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:14Z,use_quota=True,user_id='022597ac888d41f098792561099e1267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd0e376-e9cd-4d6c-bf2e-a735d5998c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd0e376-e9cd-4d6c-bf2e-a735d5998c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773892f0-ec0d-406f-973d-60a5490a54fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773892f0-ec0d-406f-973d-60a5490a54fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb229a8-3a97-4a83-a979-09c32c2d3925', 'volume_name': 'volume-1bb229a8-3a97-4a83-a979-09c32c2d3925', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c69c758-2e54-4c39-8f65-caaee71f6de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c69c758-2e54-4c39-8f65-caaee71f6de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7ae917-b64e-467f-a791-a93718c7c78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:13 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Volume 1bb229a8-3a97-4a83-a979-09c32c2d3925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb229a8-3a97-4a83-a979-09c32c2d3925', 'volume_size': 1}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1838113767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb229a8-3a97-4a83-a979-09c32c2d3925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c677e1a59f74475d94f48e1f586c7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:14Z,use_quota=True,user_id='022597ac888d41f098792561099e1267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Creating volume 1bb229a8-3a97-4a83-a979-09c32c2d3925 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:31:13 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1bb229a8-3a97-4a83-a979-09c32c2d3925 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:13 devstack sudo[104334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1bb229a8-3a97-4a83-a979-09c32c2d3925 1073741824
Aug 04 09:31:13 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:13 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66" returned: 0 in 0.403s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b2be6e0-6437-4313-9051-ea48cede45b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc57beac-8a7e-44c1-aa62-59c93ebe719e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:14 devstack sudo[104340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5
Aug 04 09:31:14 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:14 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1bb229a8-3a97-4a83-a979-09c32c2d3925 1073741824" returned: 0 in 0.527s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1bb229a8-3a97-4a83-a979-09c32c2d3925 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:14 devstack sudo[104347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1bb229a8-3a97-4a83-a979-09c32c2d3925
Aug 04 09:31:14 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:14 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5" returned: 0 in 0.443s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:14 devstack sudo[104350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66
Aug 04 09:31:14 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:14 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1bb229a8-3a97-4a83-a979-09c32c2d3925" returned: 0 in 0.327s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7ae917-b64e-467f-a791-a93718c7c78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb229a8-3a97-4a83-a979-09c32c2d3925', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6240572-8250-45e0-82a0-359bce772bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:14 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Volume volume-1bb229a8-3a97-4a83-a979-09c32c2d3925 (1bb229a8-3a97-4a83-a979-09c32c2d3925): created successfully
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6240572-8250-45e0-82a0-359bce772bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Flow 'volume_create_manager' (05d59036-9206-4154-bf9c-b77c83886462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:14 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6a56a66d-c86f-46c6-82aa-48ec6667019c tempest-VolumesTransfersV355Test-1206262453 None] Created volume successfully.
Aug 04 09:31:14 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66" returned: 0 in 0.409s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:14 devstack sudo[104357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66
Aug 04 09:31:14 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:15 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5.b041cc52-eee4-41cd-b424-ae93f5013f66" returned: 0 in 0.252s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-quobyte-b041cc52-eee4-41cd-b424-ae93f5013f66" released by "_delete_snapshot" :: held 1.668s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-quobyte-2b2be6e0-6437-4313-9051-ea48cede45b5" released by "delete_snapshot" :: held 1.705s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:15 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Created reservations ['70a584e4-3cf5-4e40-80cc-c6a961dcde85', 'be486465-f9c9-4bc5-888a-fd7e6b16c1c9', '6dc5d923-2534-4c03-9352-6272a7bfe373', 'c537bf8a-af8f-4b97-8643-8b4fe98d4bb6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:31:15 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Delete snapshot completed successfully.
Aug 04 09:31:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4a44d627-86d4-44c9-9bae-b26ddce04018 tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-b041cc52-eee4-41cd-b424-ae93f5013f66-delete_snapshot" released by "delete_snapshot" :: held 1.881s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "cinder-2b2be6e0-6437-4313-9051-ea48cede45b5-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-2b2be6e0-6437-4313-9051-ea48cede45b5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "cinder-quobyte-2b2be6e0-6437-4313-9051-ea48cede45b5" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-quobyte-2b2be6e0-6437-4313-9051-ea48cede45b5" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:15 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff2bcf8-74ba-44db-a7d3-de2201bd500f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:15 devstack sudo[104360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5
Aug 04 09:31:15 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:16 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5" returned: 0 in 0.399s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:16 devstack sudo[104365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5
Aug 04 09:31:16 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:16 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2b2be6e0-6437-4313-9051-ea48cede45b5" returned: 0 in 0.339s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-quobyte-2b2be6e0-6437-4313-9051-ea48cede45b5" released by "delete_volume" :: held 0.818s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Created reservations ['971ec6ec-82a8-4610-9ba9-c36df0e4fd52', '5f7d577b-5a3e-42ca-8b23-e83c3436cfa6', 'c79be532-c057-4d9a-9e61-1e6dc6778eaa', '98b12f26-575e-4b0d-8dc0-ae41239b0439'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:16 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3260af80-a1c6-49d8-bf84-1bf482d7d290 tempest-VolumesTransfersV355Test-64454027 None] Transfer volume completed successfully.
Aug 04 09:31:16 devstack sudo[104369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:31:16 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "cinder-1c57e803-d670-4745-ad95-999037885310-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-1c57e803-d670-4745-ad95-999037885310-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "cinder-quobyte-1c57e803-d670-4745-ad95-999037885310" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-quobyte-1c57e803-d670-4745-ad95-999037885310" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c22524-519f-47d2-abd9-9e98657ae766]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c57e803-d670-4745-ad95-999037885310 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:16 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.353s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:31:16 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Deleted volume successfully.
Aug 04 09:31:16 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-8b79ee99-c77c-4997-a6a0-00841eff586e tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-2b2be6e0-6437-4313-9051-ea48cede45b5-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:17 devstack sudo[104372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c57e803-d670-4745-ad95-999037885310
Aug 04 09:31:17 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:17 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Acquiring lock "cinder-1bb229a8-3a97-4a83-a979-09c32c2d3925-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c57e803-d670-4745-ad95-999037885310" returned: 0 in 0.411s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c57e803-d670-4745-ad95-999037885310 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Lock "cinder-1bb229a8-3a97-4a83-a979-09c32c2d3925-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:17 devstack sudo[104377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c57e803-d670-4745-ad95-999037885310
Aug 04 09:31:17 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Acquiring lock "cinder-quobyte-1bb229a8-3a97-4a83-a979-09c32c2d3925" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Lock "cinder-quobyte-1bb229a8-3a97-4a83-a979-09c32c2d3925" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf92f0fe-559b-4ccc-a3cb-7d6311de73bd]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1bb229a8-3a97-4a83-a979-09c32c2d3925 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:17 devstack sudo[104379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1bb229a8-3a97-4a83-a979-09c32c2d3925
Aug 04 09:31:17 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:17 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c57e803-d670-4745-ad95-999037885310" returned: 0 in 0.299s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-quobyte-1c57e803-d670-4745-ad95-999037885310" released by "delete_volume" :: held 0.765s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Created reservations ['f7a93add-e72c-4c93-8a4b-4d16fb668e59', 'a1d7b0f1-ed70-4610-aa9e-85ed4ef9303c', '68b9cfe4-3143-4757-b216-73cbab3c5c81', '66660275-f608-48e5-9d9f-999a5953157c'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:17 devstack sudo[104387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:31:17 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:17 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1bb229a8-3a97-4a83-a979-09c32c2d3925" returned: 0 in 0.510s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1bb229a8-3a97-4a83-a979-09c32c2d3925 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:17 devstack sudo[104389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1bb229a8-3a97-4a83-a979-09c32c2d3925
Aug 04 09:31:17 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:18 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.360s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:31:18 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Deleted volume successfully.
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-490f0ff6-2272-4d7c-a9c6-f980257c3847 tempest-CinderUnicodeTest-1041556285 None] Lock "cinder-1c57e803-d670-4745-ad95-999037885310-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:18 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1bb229a8-3a97-4a83-a979-09c32c2d3925" returned: 0 in 0.346s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Lock "cinder-quobyte-1bb229a8-3a97-4a83-a979-09c32c2d3925" released by "delete_volume" :: held 0.909s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Created reservations ['cc205d39-9dcc-43f8-bcf4-74e8ba580395', 'dfaa426f-f7cb-414c-90b4-5006732283a1', '2f54b4fe-4697-4075-a1f8-653caa29becb', '7c995c05-deba-4939-915a-8058c0807d5b'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:18 devstack sudo[104393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:31:18 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:18 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.290s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:31:18 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Deleted volume successfully.
Aug 04 09:31:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-62f4e1c0-3607-4fff-8c38-2516dc1f082f tempest-VolumesTransfersV355Test-1080656336 None] Lock "cinder-1bb229a8-3a97-4a83-a979-09c32c2d3925-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Flow 'volume_create_manager' (9067a448-8353-4d8e-ba57-e24ad5ec8e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cc6b3c-ac38-4c83-ba85-545d3c39a7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cc6b3c-ac38-4c83-ba85-545d3c39a7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-744153078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a819850-1218-483d-9e24-2fba10b9d70e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c677e1a59f74475d94f48e1f586c7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:20Z,use_quota=True,user_id='022597ac888d41f098792561099e1267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c37908-2ebb-4b92-a7fa-1886b9e8bfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c37908-2ebb-4b92-a7fa-1886b9e8bfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10042f97-caab-4736-92dd-f01b0000222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10042f97-caab-4736-92dd-f01b0000222a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a819850-1218-483d-9e24-2fba10b9d70e', 'volume_name': 'volume-8a819850-1218-483d-9e24-2fba10b9d70e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ee46dc-f2bd-458e-8b82-8e7b0419c22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ee46dc-f2bd-458e-8b82-8e7b0419c22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69955f9-afc3-42b7-bba3-3a7388520f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:20 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Volume 8a819850-1218-483d-9e24-2fba10b9d70e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a819850-1218-483d-9e24-2fba10b9d70e', 'volume_size': 1}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-744153078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a819850-1218-483d-9e24-2fba10b9d70e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c677e1a59f74475d94f48e1f586c7956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:20Z,use_quota=True,user_id='022597ac888d41f098792561099e1267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Creating volume 8a819850-1218-483d-9e24-2fba10b9d70e {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:31:20 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8a819850-1218-483d-9e24-2fba10b9d70e 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:20 devstack sudo[104397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8a819850-1218-483d-9e24-2fba10b9d70e 1073741824
Aug 04 09:31:20 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:20 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8a819850-1218-483d-9e24-2fba10b9d70e 1073741824" returned: 0 in 0.561s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8a819850-1218-483d-9e24-2fba10b9d70e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:20 devstack sudo[104403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8a819850-1218-483d-9e24-2fba10b9d70e
Aug 04 09:31:20 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:21 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8a819850-1218-483d-9e24-2fba10b9d70e" returned: 0 in 0.263s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:31:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69955f9-afc3-42b7-bba3-3a7388520f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a819850-1218-483d-9e24-2fba10b9d70e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60be3543-c075-431e-ad02-622ff1915ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:21 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Volume volume-8a819850-1218-483d-9e24-2fba10b9d70e (8a819850-1218-483d-9e24-2fba10b9d70e): created successfully
Aug 04 09:31:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60be3543-c075-431e-ad02-622ff1915ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Flow 'volume_create_manager' (9067a448-8353-4d8e-ba57-e24ad5ec8e91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:21 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e7799342-4ce1-4fd1-bf20-10377605412c tempest-VolumesTransfersV355Test-1206262453 None] Created volume successfully.
Aug 04 09:31:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Acquiring lock "cinder-8a819850-1218-483d-9e24-2fba10b9d70e-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Lock "cinder-8a819850-1218-483d-9e24-2fba10b9d70e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Acquiring lock "cinder-quobyte-8a819850-1218-483d-9e24-2fba10b9d70e" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Lock "cinder-quobyte-8a819850-1218-483d-9e24-2fba10b9d70e" acquired by "delete_volume" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:22 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21d808c-3375-4de7-8420-20bbb8fc2b71]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8a819850-1218-483d-9e24-2fba10b9d70e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:22 devstack sudo[104406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8a819850-1218-483d-9e24-2fba10b9d70e
Aug 04 09:31:22 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:23 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8a819850-1218-483d-9e24-2fba10b9d70e" returned: 0 in 0.422s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8a819850-1218-483d-9e24-2fba10b9d70e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:23 devstack sudo[104411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8a819850-1218-483d-9e24-2fba10b9d70e
Aug 04 09:31:23 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:23 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8a819850-1218-483d-9e24-2fba10b9d70e" returned: 0 in 0.298s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Lock "cinder-quobyte-8a819850-1218-483d-9e24-2fba10b9d70e" released by "delete_volume" :: held 0.769s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Created reservations ['846c82de-3b05-4b32-b1c2-45cb5d12f9bc', '55d02cbd-2f84-487f-ba39-f6ac98309ca6', 'f06b1e00-e0db-4492-ac41-9531f2dfa9f1', '1c6a9a7a-2639-44f8-aa52-c289c54aa165'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:23 devstack sudo[104414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:31:23 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:23 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.343s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:31:23 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Deleted volume successfully.
Aug 04 09:31:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-51ea752b-2848-4e29-bb7e-2a8695482373 tempest-VolumesTransfersV355Test-1080656336 None] Lock "cinder-8a819850-1218-483d-9e24-2fba10b9d70e-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Flow 'volume_create_manager' (9b21201b-ee41-4516-b0f2-854e3928740c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34518ac-6926-44fe-bb59-56d3c6f24635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34518ac-6926-44fe-bb59-56d3c6f24635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-911014468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acd88414c6b444492211f1c5f28f724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:24Z,use_quota=True,user_id='ee368ad7df2742ebacd512c815eb98d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e604b20-57c7-4187-9dd5-26cf15141e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e604b20-57c7-4187-9dd5-26cf15141e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be6f0ad-b742-4e86-8dc6-416c30741096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be6f0ad-b742-4e86-8dc6-416c30741096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5', 'volume_name': 'volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe91d54-5326-4d23-924e-a5e8d88b13dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe91d54-5326-4d23-924e-a5e8d88b13dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3daa8277-c989-4522-aa3c-d7bdb96b4cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:24 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Volume 68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5', 'volume_size': 1}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-911014468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acd88414c6b444492211f1c5f28f724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:24Z,use_quota=True,user_id='ee368ad7df2742ebacd512c815eb98d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Creating volume 68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:31:24 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:31:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:24 devstack sudo[104417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5 1073741824
Aug 04 09:31:24 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Flow 'volume_create_manager' (8a6fecc8-3887-4c24-b213-184bbcc0158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba60dca-0713-4159-93ad-15ff0c9e417e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba60dca-0713-4159-93ad-15ff0c9e417e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1961434699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c54e999-0c4c-4158-9f76-f5e4ae5821b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acd88414c6b444492211f1c5f28f724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:25Z,use_quota=True,user_id='ee368ad7df2742ebacd512c815eb98d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94deebb-18e3-43e5-9da9-880c6e0f6f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94deebb-18e3-43e5-9da9-880c6e0f6f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fff065-6c14-4676-8913-2b60cb6a2ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fff065-6c14-4676-8913-2b60cb6a2ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c54e999-0c4c-4158-9f76-f5e4ae5821b2', 'volume_name': 'volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03da1976-7cf8-4252-8014-39ee298ec6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03da1976-7cf8-4252-8014-39ee298ec6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4454263b-7d38-4188-977d-90d631878a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:25 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Volume 5c54e999-0c4c-4158-9f76-f5e4ae5821b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2', 'volume_size': 1}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:25 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5 1073741824" returned: 0 in 0.589s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:25 devstack sudo[104424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5
Aug 04 09:31:25 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:25 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5" returned: 0 in 0.265s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.348s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1961434699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c54e999-0c4c-4158-9f76-f5e4ae5821b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acd88414c6b444492211f1c5f28f724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:25Z,use_quota=True,user_id='ee368ad7df2742ebacd512c815eb98d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Creating volume 5c54e999-0c4c-4158-9f76-f5e4ae5821b2 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:31:25 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3daa8277-c989-4522-aa3c-d7bdb96b4cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4641e1cc-2e55-4d2c-ba32-23ee78931c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:25 devstack sudo[104427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2 1073741824
Aug 04 09:31:25 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:25 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Volume volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5 (68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5): created successfully
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4641e1cc-2e55-4d2c-ba32-23ee78931c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Flow 'volume_create_manager' (9b21201b-ee41-4516-b0f2-854e3928740c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:25 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-614788d1-3410-4ee2-8bc2-57db45d11f65 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Created volume successfully.
Aug 04 09:31:26 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2 1073741824" returned: 0 in 0.504s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:26 devstack sudo[104433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2
Aug 04 09:31:26 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:26 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2" returned: 0 in 0.317s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:26 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:31:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4454263b-7d38-4188-977d-90d631878a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13c7f6a-d692-4dcb-9329-65f19f1ea3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:26 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Volume volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2 (5c54e999-0c4c-4158-9f76-f5e4ae5821b2): created successfully
Aug 04 09:31:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13c7f6a-d692-4dcb-9329-65f19f1ea3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Flow 'volume_create_manager' (8a6fecc8-3887-4c24-b213-184bbcc0158a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:26 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ca300d2f-012b-4915-bbf1-aa8fbf40d78a tempest-TestServerVolumeAttachmentScenario-1248602601 None] Created volume successfully.
Aug 04 09:31:36 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=91,cinder:SELECT=69,cinder:INSERT=26,cinder:DELETE=4 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:31:36 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=48,cinder:DELETE=8,cinder:SELECT=36,cinder:INSERT=11 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:31:44 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:31:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Flow 'volume_create_manager' (9c799b65-7884-4c9f-811a-ca52544954fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ad83b2-9236-4adb-aedf-0b3d4ca56c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ad83b2-9236-4adb-aedf-0b3d4ca56c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824032847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b186fa55-1289-43ac-8b38-75a764df88c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d3e60cc4f14e0d9c3b97c089a254aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:45Z,use_quota=True,user_id='a7af36436b6b44f0a71baccb2ac455e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c469e0d-7f95-4792-89d6-929403c6b46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c469e0d-7f95-4792-89d6-929403c6b46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbfbfcd-b71f-4c41-9729-3f7eeb9e434f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbfbfcd-b71f-4c41-9729-3f7eeb9e434f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b186fa55-1289-43ac-8b38-75a764df88c6', 'volume_name': 'volume-b186fa55-1289-43ac-8b38-75a764df88c6', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50cc71e9-1850-4599-badd-4bae4fa2beab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50cc71e9-1850-4599-badd-4bae4fa2beab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778c512f-3723-48b7-8f20-8faa4b9e5152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:45 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Volume b186fa55-1289-43ac-8b38-75a764df88c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b186fa55-1289-43ac-8b38-75a764df88c6', 'volume_size': 1}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824032847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b186fa55-1289-43ac-8b38-75a764df88c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d3e60cc4f14e0d9c3b97c089a254aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:45Z,use_quota=True,user_id='a7af36436b6b44f0a71baccb2ac455e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Creating volume b186fa55-1289-43ac-8b38-75a764df88c6 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:31:45 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:45 devstack sudo[104558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 1073741824
Aug 04 09:31:45 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Flow 'volume_create_manager' (8173dd4e-1850-4583-a070-df6788ffd0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaffc33-ea02-49ff-873a-20545ad7de91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaffc33-ea02-49ff-873a-20545ad7de91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-138147878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56af275b-bd90-4b8c-946b-43b58ff8363c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dda0d3d69724f3489ba75face40b47f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:46Z,use_quota=True,user_id='e49aa9eccd3440f9898437966e0ecb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85cd74b-9a41-431e-b88d-c59ee70de778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85cd74b-9a41-431e-b88d-c59ee70de778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3f04e7-9629-4e3b-9141-ba9077244b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3f04e7-9629-4e3b-9141-ba9077244b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56af275b-bd90-4b8c-946b-43b58ff8363c', 'volume_name': 'volume-56af275b-bd90-4b8c-946b-43b58ff8363c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9113ba1-7c1c-4df4-b7ef-6d598e245893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9113ba1-7c1c-4df4-b7ef-6d598e245893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8dc718b-49dd-44a0-8d2c-a5af8ce5872b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:45 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Volume 56af275b-bd90-4b8c-946b-43b58ff8363c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56af275b-bd90-4b8c-946b-43b58ff8363c', 'volume_size': 1}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:45 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 1073741824" returned: 0 in 0.723s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:45 devstack sudo[104580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6
Aug 04 09:31:45 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:46 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6" returned: 0 in 0.332s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.423s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-138147878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56af275b-bd90-4b8c-946b-43b58ff8363c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dda0d3d69724f3489ba75face40b47f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:46Z,use_quota=True,user_id='e49aa9eccd3440f9898437966e0ecb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Creating volume 56af275b-bd90-4b8c-946b-43b58ff8363c {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:31:46 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778c512f-3723-48b7-8f20-8faa4b9e5152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b186fa55-1289-43ac-8b38-75a764df88c6', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1694876-9c57-4131-b831-24486d0a7b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:46 devstack sudo[104583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c 1073741824
Aug 04 09:31:46 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:46 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Volume volume-b186fa55-1289-43ac-8b38-75a764df88c6 (b186fa55-1289-43ac-8b38-75a764df88c6): created successfully
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1694876-9c57-4131-b831-24486d0a7b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Flow 'volume_create_manager' (9c799b65-7884-4c9f-811a-ca52544954fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:46 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9ff9488e-2b6d-40cb-b888-4dfbc85e019e tempest-VolumesActionsTest-39635361 None] Created volume successfully.
Aug 04 09:31:46 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c 1073741824" returned: 0 in 0.610s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:46 devstack sudo[104589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c
Aug 04 09:31:46 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:47 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c" returned: 0 in 0.248s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:31:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8dc718b-49dd-44a0-8d2c-a5af8ce5872b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56af275b-bd90-4b8c-946b-43b58ff8363c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426b272a-2c9b-4470-a4c1-246ea532c126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:47 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Volume volume-56af275b-bd90-4b8c-946b-43b58ff8363c (56af275b-bd90-4b8c-946b-43b58ff8363c): created successfully
Aug 04 09:31:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426b272a-2c9b-4470-a4c1-246ea532c126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Flow 'volume_create_manager' (8173dd4e-1850-4583-a070-df6788ffd0a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:47 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1cd3376b-e5d3-4408-a80f-433ea3498b19 tempest-SnapshotDependencyTests-108664119 None] Created volume successfully.
Aug 04 09:31:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] Creating offline snapshot c8b9c815-c7db-405f-bb41-aa512185674c of volume 56af275b-bd90-4b8c-946b-43b58ff8363c {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:31:48 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf4194e-4dd5-4b96-8cfd-bff5b8b01925]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:48 devstack sudo[104595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c
Aug 04 09:31:48 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:48 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c" returned: 0 in 0.445s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:48 devstack sudo[104600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c 1G
Aug 04 09:31:48 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:49 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c 1G" returned: 0 in 0.623s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56af275b-bd90-4b8c-946b-43b58ff8363c -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:49 devstack sudo[104609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56af275b-bd90-4b8c-946b-43b58ff8363c -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c
Aug 04 09:31:49 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:49 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56af275b-bd90-4b8c-946b-43b58ff8363c -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c" returned: 0 in 0.678s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:49 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c is being set with open permissions: ugo+rw
Aug 04 09:31:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:49 devstack sudo[104616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c
Aug 04 09:31:49 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:50 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c" returned: 0 in 0.518s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:50 devstack sudo[104624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.info
Aug 04 09:31:50 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:50 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.info" returned: 0 in 0.551s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:50 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.info is being set with open permissions: ugo+rw
Aug 04 09:31:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:51 devstack sudo[104640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.info
Aug 04 09:31:51 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:51 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.info" returned: 0 in 0.646s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.651s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:51 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3a1e0177-c2c5-4c59-825e-670e87ffbe5d tempest-SnapshotDependencyTests-108664119 None] Create snapshot completed successfully
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Flow 'volume_create_manager' (ecfb6d6f-3fe6-41b6-be92-e777fbcd0160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2a90f9-9c6a-4db4-b382-0824578b27d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2a90f9-9c6a-4db4-b382-0824578b27d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b6048c-c490-4db1-9fc8-3b75ce80a9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dda0d3d69724f3489ba75face40b47f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8b9c815-c7db-405f-bb41-aa512185674c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:31:53Z,use_quota=True,user_id='e49aa9eccd3440f9898437966e0ecb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6406269-2620-4b27-a795-20d56a4d172f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6406269-2620-4b27-a795-20d56a4d172f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc531e0-29f7-4742-a847-86d4578d5c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc531e0-29f7-4742-a847-86d4578d5c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '46b6048c-c490-4db1-9fc8-3b75ce80a9c8', 'volume_name': 'volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8', 'volume_size': 1, 'snapshot_id': 'c8b9c815-c7db-405f-bb41-aa512185674c'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b9353a-3034-4329-a594-b9af1663f393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b9353a-3034-4329-a594-b9af1663f393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadc66e0-b4bb-4e6d-a3f5-a831a1bbf813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:31:53 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Volume 46b6048c-c490-4db1-9fc8-3b75ce80a9c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8', 'volume_size': 1, 'snapshot_id': 'c8b9c815-c7db-405f-bb41-aa512185674c'}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "cinder-quobyte-c8b9c815-c7db-405f-bb41-aa512185674c-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" by "_create_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-quobyte-c8b9c815-c7db-405f-bb41-aa512185674c-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Creating volume 46b6048c-c490-4db1-9fc8-3b75ce80a9c8 from snapshot c8b9c815-c7db-405f-bb41-aa512185674c {{(pid=88880) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "cinder-quobyte-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" by "_copy_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-quobyte-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] snapshot: c8b9c815-c7db-405f-bb41-aa512185674c, volume: 46b6048c-c490-4db1-9fc8-3b75ce80a9c8,  {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d09274-7484-4673-a439-6eecf21759e5]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:53 devstack sudo[104664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c
Aug 04 09:31:53 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:54 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c" returned: 0 in 0.992s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56af275b-bd90-4b8c-946b-43b58ff8363c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:31:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Aug 04 09:31:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Creating direct copy from snapshot {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Aug 04 09:31:54 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3502fe1-16cf-4766-98f5-3f0c63397c80]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:31:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:54 devstack sudo[104708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c
Aug 04 09:31:54 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:55 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root
Aug 04 09:31:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c" returned: 0 in 0.754s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:31:55 devstack cinder-volume[88880]: DEBUG cinder.utils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Path /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8 not found in is_blk_device check {{(pid=88880) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 04 09:31:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:31:55 devstack sudo[104739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8
Aug 04 09:31:55 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:31:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c92114e3-1591-4dd9-9c70-29e156885c82 tempest-VolumesActionsTest-39635361 None] Acquiring lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6" by "attach_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:31:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c92114e3-1591-4dd9-9c70-29e156885c82 tempest-VolumesActionsTest-39635361 None] Lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6" acquired by "attach_volume" :: waited 0.083s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:31:59 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-c92114e3-1591-4dd9-9c70-29e156885c82 tempest-VolumesActionsTest-39635361 None] Attaching volume b186fa55-1289-43ac-8b38-75a764df88c6 to instance a7d08b15-7d53-479a-a2e6-cdf10b867dc8 at mountpoint /dev/vdb on host None.
Aug 04 09:31:59 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-c92114e3-1591-4dd9-9c70-29e156885c82 tempest-VolumesActionsTest-39635361 None] Attach volume completed successfully.
Aug 04 09:31:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c92114e3-1591-4dd9-9c70-29e156885c82 tempest-VolumesActionsTest-39635361 None] Lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6" released by "attach_volume" :: held 0.343s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3eb23564-fa91-41d0-ac52-d8abebda9a8c tempest-VolumesActionsTest-39635361 None] Acquiring lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6-detach_volume" by "detach_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3eb23564-fa91-41d0-ac52-d8abebda9a8c tempest-VolumesActionsTest-39635361 None] Lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:00 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3eb23564-fa91-41d0-ac52-d8abebda9a8c tempest-VolumesActionsTest-39635361 None] Detaching volume b186fa55-1289-43ac-8b38-75a764df88c6 from instance a7d08b15-7d53-479a-a2e6-cdf10b867dc8.
Aug 04 09:32:00 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3eb23564-fa91-41d0-ac52-d8abebda9a8c tempest-VolumesActionsTest-39635361 None] Detach volume completed successfully.
Aug 04 09:32:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3eb23564-fa91-41d0-ac52-d8abebda9a8c tempest-VolumesActionsTest-39635361 None] Lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6-detach_volume" released by "detach_volume" :: held 0.185s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:02 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" returned: 0 in 6.881s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:02 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b2771-8f65-4dec-b73b-0eabcbe0ec40]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:02 devstack sudo[104800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c
Aug 04 09:32:02 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:02 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c" returned: 0 in 0.732s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:02 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:32:02 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Converted 1024.00 MB image at 148.79 MB/s
Aug 04 09:32:02 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8 is being set with open permissions: ugo+rw
Aug 04 09:32:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:02 devstack sudo[104821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8
Aug 04 09:32:02 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:03 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" returned: 0 in 0.295s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-quobyte-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" released by "_copy_volume_from_snapshot" :: held 9.888s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-quobyte-c8b9c815-c7db-405f-bb41-aa512185674c-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" released by "_create_volume_from_snapshot" :: held 9.933s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.955s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadc66e0-b4bb-4e6d-a3f5-a831a1bbf813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8', 'volume_size': 1, 'snapshot_id': 'c8b9c815-c7db-405f-bb41-aa512185674c'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fce442-b7b6-4c8a-a111-4e1646a70230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:32:03 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Volume volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8 (46b6048c-c490-4db1-9fc8-3b75ce80a9c8): created successfully
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fce442-b7b6-4c8a-a111-4e1646a70230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Flow 'volume_create_manager' (ecfb6d6f-3fe6-41b6-be92-e777fbcd0160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:32:03 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-128e64c1-d16d-42bf-b12f-14cebabbab16 tempest-SnapshotDependencyTests-108664119 None] Created volume successfully.
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "cinder-c8b9c815-c7db-405f-bb41-aa512185674c-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-c8b9c815-c7db-405f-bb41-aa512185674c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "cinder-quobyte-56af275b-bd90-4b8c-946b-43b58ff8363c" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-quobyte-56af275b-bd90-4b8c-946b-43b58ff8363c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "cinder-quobyte-c8b9c815-c7db-405f-bb41-aa512185674c" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-quobyte-c8b9c815-c7db-405f-bb41-aa512185674c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Deleting offline snapshot c8b9c815-c7db-405f-bb41-aa512185674c of volume 56af275b-bd90-4b8c-946b-43b58ff8363c {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] snapshot_file for this snap is: volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f68cb3-b5d6-431c-8976-d4e9f8578025]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:03 devstack sudo[104826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c
Aug 04 09:32:03 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:04 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c" returned: 0 in 0.338s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56af275b-bd90-4b8c-946b-43b58ff8363c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:32:04 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ddf703-1ae5-4c89-a946-d931ab5c9b4b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:04 devstack sudo[104831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c
Aug 04 09:32:04 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:04 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c" returned: 0 in 0.350s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:04 devstack sudo[104836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c
Aug 04 09:32:04 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:04 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c" returned: 0 in 0.367s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:04 devstack sudo[104842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c
Aug 04 09:32:04 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:04 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c.c8b9c815-c7db-405f-bb41-aa512185674c" returned: 0 in 0.245s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-quobyte-c8b9c815-c7db-405f-bb41-aa512185674c" released by "_delete_snapshot" :: held 1.390s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-quobyte-56af275b-bd90-4b8c-946b-43b58ff8363c" released by "delete_snapshot" :: held 1.411s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:05 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Created reservations ['1c8a968f-99c3-4f54-9aac-0d409244791e', 'd53df702-e319-4b06-9a0d-b19e8b2b0b87', 'a83826d9-ab0b-490f-9462-14656b76ecb8', 'ceb0a718-ded7-4fc3-a673-394ef7defbb4'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:32:05 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Delete snapshot completed successfully.
Aug 04 09:32:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-684bcca8-6720-4e0e-b837-8cc223c904b8 tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-c8b9c815-c7db-405f-bb41-aa512185674c-delete_snapshot" released by "delete_snapshot" :: held 1.567s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "cinder-56af275b-bd90-4b8c-946b-43b58ff8363c-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-56af275b-bd90-4b8c-946b-43b58ff8363c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "cinder-quobyte-56af275b-bd90-4b8c-946b-43b58ff8363c" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-quobyte-56af275b-bd90-4b8c-946b-43b58ff8363c" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:05 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[709f0b47-c823-4371-aa84-ef5cbcf2e1fd]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:05 devstack sudo[104848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c
Aug 04 09:32:05 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:06 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c" returned: 0 in 0.372s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:06 devstack sudo[104853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c
Aug 04 09:32:06 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:06 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-56af275b-bd90-4b8c-946b-43b58ff8363c" returned: 0 in 0.296s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-quobyte-56af275b-bd90-4b8c-946b-43b58ff8363c" released by "delete_volume" :: held 0.733s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Created reservations ['91ff37e9-3b2c-48be-b895-26f058d11aed', '4da8e70c-45db-4017-b420-2deda750abcf', '71ec77d1-abc0-4dd7-8741-88926786c4e3', 'ef0c8a72-3dff-44bb-a3c9-e9e6859838c6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:06 devstack sudo[104860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:32:06 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "cinder-46b6048c-c490-4db1-9fc8-3b75ce80a9c8-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-46b6048c-c490-4db1-9fc8-3b75ce80a9c8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "cinder-quobyte-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-quobyte-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" acquired by "delete_volume" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:07 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.378s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:32:07 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Deleted volume successfully.
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b11ebab-bded-454a-ae94-e4ed3f8dbcc7]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fc816a34-f42a-4559-85a4-313fa4e59e8f tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-56af275b-bd90-4b8c-946b-43b58ff8363c-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:07 devstack sudo[104872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8
Aug 04 09:32:07 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:07 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" returned: 0 in 0.394s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:07 devstack sudo[104879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8
Aug 04 09:32:07 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:07 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" returned: 0 in 0.276s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-quobyte-46b6048c-c490-4db1-9fc8-3b75ce80a9c8" released by "delete_volume" :: held 0.735s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Created reservations ['71a0a119-1988-49e0-8319-cfcabd29b767', '9df75c4c-2d7c-46c0-aace-d7f2d3349f79', '1568d638-5182-4b1e-adfe-b399e4819813', '4f1e0281-bc54-4a1d-a391-dabc61446a88'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:32:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:07 devstack sudo[104882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:32:07 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:08 devstack sudo[104884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:32:08 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:08 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.262s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:32:08 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Deleted volume successfully.
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e14482db-5a72-4e30-b1a7-c9ca419b6d0e tempest-SnapshotDependencyTests-108664119 None] Lock "cinder-46b6048c-c490-4db1-9fc8-3b75ce80a9c8-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:08 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.332s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:32:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:32:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-0bb9cd1f-017f-49c5-b5e4-29a46f3ef925 req-083dd432-f94e-4ea7-bb72-14c746cdd5af tempest-TestServerVolumeAttachmentScenario-1248602601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:32:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-0bb9cd1f-017f-49c5-b5e4-29a46f3ef925 req-083dd432-f94e-4ea7-bb72-14c746cdd5af tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:32:13 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2bb0fb-1c98-4a78-86ce-8cb9648c1f69]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-0bb9cd1f-017f-49c5-b5e4-29a46f3ef925 req-083dd432-f94e-4ea7-bb72-14c746cdd5af tempest-TestServerVolumeAttachmentScenario-1248602601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f3996da1-e3bb-49a2-95b2-3cfc5ef244db tempest-VolumesActionsTest-39635361 None] Acquiring lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6" by "attach_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f3996da1-e3bb-49a2-95b2-3cfc5ef244db tempest-VolumesActionsTest-39635361 None] Lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6" acquired by "attach_volume" :: waited 0.031s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f3996da1-e3bb-49a2-95b2-3cfc5ef244db tempest-VolumesActionsTest-39635361 None] Attaching volume b186fa55-1289-43ac-8b38-75a764df88c6 to instance 68dc6dca-882b-4962-a636-8cc976a9be1b at mountpoint /dev/vdb on host None.
Aug 04 09:32:13 devstack sudo[104988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5
Aug 04 09:32:13 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f3996da1-e3bb-49a2-95b2-3cfc5ef244db tempest-VolumesActionsTest-39635361 None] Attach volume completed successfully.
Aug 04 09:32:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f3996da1-e3bb-49a2-95b2-3cfc5ef244db tempest-VolumesActionsTest-39635361 None] Lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6" released by "attach_volume" :: held 0.209s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4f332f12-9a6a-443a-99a0-47369920beea tempest-VolumesActionsTest-39635361 None] Acquiring lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6-detach_volume" by "detach_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4f332f12-9a6a-443a-99a0-47369920beea tempest-VolumesActionsTest-39635361 None] Lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:14 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4f332f12-9a6a-443a-99a0-47369920beea tempest-VolumesActionsTest-39635361 None] Detaching volume b186fa55-1289-43ac-8b38-75a764df88c6 from instance 68dc6dca-882b-4962-a636-8cc976a9be1b.
Aug 04 09:32:14 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-0bb9cd1f-017f-49c5-b5e4-29a46f3ef925 req-083dd432-f94e-4ea7-bb72-14c746cdd5af tempest-TestServerVolumeAttachmentScenario-1248602601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5" returned: 0 in 0.623s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-0bb9cd1f-017f-49c5-b5e4-29a46f3ef925 req-083dd432-f94e-4ea7-bb72-14c746cdd5af tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.648s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:32:14 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4f332f12-9a6a-443a-99a0-47369920beea tempest-VolumesActionsTest-39635361 None] Detach volume completed successfully.
Aug 04 09:32:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4f332f12-9a6a-443a-99a0-47369920beea tempest-VolumesActionsTest-39635361 None] Lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-0bb9cd1f-017f-49c5-b5e4-29a46f3ef925 req-083dd432-f94e-4ea7-bb72-14c746cdd5af tempest-TestServerVolumeAttachmentScenario-1248602601 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83447898-bbc4-4e77-9778-c15750a1c65c', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:32:14 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-0bb9cd1f-017f-49c5-b5e4-29a46f3ef925 req-083dd432-f94e-4ea7-bb72-14c746cdd5af tempest-TestServerVolumeAttachmentScenario-1248602601 None] attachment_update completed successfully.
Aug 04 09:32:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:32:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:32:19 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9084a0-fdc7-40ea-a7d2-e9bf2e2e77b2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:19 devstack sudo[105409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6
Aug 04 09:32:19 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-f0b9e275-19bc-4393-b0a4-b9230a6c3a14 req-676e3f3d-4ffe-4aa8-a22a-389035bf0e90 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:32:19 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6" returned: 0 in 0.428s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:19 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c249408-7a5b-4cf3-9bed-ef601715ecaa]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:19 devstack sudo[105423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6
Aug 04 09:32:19 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:20 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6" returned: 0 in 0.358s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.12bf411e-9e52-4b68-9dd1-32c30d826b8ewnyxuyx9.img {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:20 devstack sudo[105429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.12bf411e-9e52-4b68-9dd1-32c30d826b8ewnyxuyx9.img
Aug 04 09:32:20 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:24 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.12bf411e-9e52-4b68-9dd1-32c30d826b8ewnyxuyx9.img" returned: 0 in 3.877s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:24 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58eccdc-2b99-4656-abc7-0821dca675b9]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:24 devstack sudo[105442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6
Aug 04 09:32:24 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:24 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6" returned: 0 in 0.486s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:24 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6, size 1024.00 MB, duration 3.88 sec, destination /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.12bf411e-9e52-4b68-9dd1-32c30d826b8ewnyxuyx9.img {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:32:24 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] Converted 1024.00 MB image at 264.06 MB/s
Aug 04 09:32:24 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] 12bf411e-9e52-4b68-9dd1-32c30d826b8e was raw, no need to convert to raw {{(pid=88880) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Aug 04 09:32:29 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=49,cinder:UPDATE=36,cinder:DELETE=3,cinder:INSERT=9 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:32:34 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=42,cinder:SELECT=45,cinder:INSERT=10,cinder:DELETE=3 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:32:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.998s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:32:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] Uploaded volume to glance image-id: 12bf411e-9e52-4b68-9dd1-32c30d826b8e. {{(pid=88880) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 04 09:32:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-f0b9e275-19bc-4393-b0a4-b9230a6c3a14 req-676e3f3d-4ffe-4aa8-a22a-389035bf0e90 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 23.571s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:32:43 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e6f8ba-8f74-4481-8b6f-186888457518]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-f0b9e275-19bc-4393-b0a4-b9230a6c3a14 req-676e3f3d-4ffe-4aa8-a22a-389035bf0e90 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:43 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-c62fba08-754f-46d0-ab0c-e81f072f5c0e tempest-VolumesActionsTest-39635361 None] Copy volume to image completed successfully.
Aug 04 09:32:43 devstack sudo[105476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2
Aug 04 09:32:43 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:43 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-f0b9e275-19bc-4393-b0a4-b9230a6c3a14 req-676e3f3d-4ffe-4aa8-a22a-389035bf0e90 tempest-TestServerVolumeAttachmentScenario-1248602601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2" returned: 0 in 0.345s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-f0b9e275-19bc-4393-b0a4-b9230a6c3a14 req-676e3f3d-4ffe-4aa8-a22a-389035bf0e90 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.373s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:32:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-f0b9e275-19bc-4393-b0a4-b9230a6c3a14 req-676e3f3d-4ffe-4aa8-a22a-389035bf0e90 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2910bd8-0b62-49c9-b68c-15227edbf923', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:32:43 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-f0b9e275-19bc-4393-b0a4-b9230a6c3a14 req-676e3f3d-4ffe-4aa8-a22a-389035bf0e90 tempest-TestServerVolumeAttachmentScenario-1248602601 None] attachment_update completed successfully.
Aug 04 09:32:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:32:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:32:45 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[93324172-1325-469c-963f-c5b36b477b95]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:45 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-94bd658d-3d69-437e-9f14-1e599fe690d0 req-965d865f-01aa-4328-b3a1-ee9f3afb5dbe tempest-TestServerVolumeAttachmentScenario-1248602601 None] Terminate volume connection completed successfully.
Aug 04 09:32:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-94bd658d-3d69-437e-9f14-1e599fe690d0 req-965d865f-01aa-4328-b3a1-ee9f3afb5dbe tempest-TestServerVolumeAttachmentScenario-1248602601 None] Deleting attachment d2910bd8-0b62-49c9-b68c-15227edbf923. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:32:45 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6
Aug 04 09:32:45 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:45 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6" returned: 0 in 0.390s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:45 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[76da4b83-018d-434f-8182-44044f2ef65f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:45 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6
Aug 04 09:32:45 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:46 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6" returned: 0 in 0.366s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:46 devstack sudo[105537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img
Aug 04 09:32:46 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:47 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-f598a1b0-e902-4910-8c20-4d1c8c9d40ff req-f1a9b55a-4b80-4c91-892a-ecb1fd1286a2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Terminate volume connection completed successfully.
Aug 04 09:32:47 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-f598a1b0-e902-4910-8c20-4d1c8c9d40ff req-f1a9b55a-4b80-4c91-892a-ecb1fd1286a2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Deleting attachment 83447898-bbc4-4e77-9778-c15750a1c65c. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:32:50 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img" returned: 0 in 4.572s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:50 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d91a8d7-7049-40b4-b811-95d06bfe2300]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:50 devstack sudo[105583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6
Aug 04 09:32:50 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:51 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6" returned: 0 in 0.707s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:51 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6, size 1024.00 MB, duration 4.57 sec, destination /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:32:51 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Converted 1024.00 MB image at 223.93 MB/s
Aug 04 09:32:51 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] a97ddbef-cc5a-4856-83b1-cd6f498c5e58 was raw, converting to qcow2 {{(pid=88880) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Aug 04 09:32:51 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d4bf86-ba8d-4c14-a7f2-b1e471c0c4b4]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:51 devstack sudo[105590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img
Aug 04 09:32:51 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:51 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img" returned: 0 in 0.346s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:51 devstack sudo[105595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img
Aug 04 09:32:51 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:52 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img" returned: 1 in 0.365s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:32:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img /opt/stack/data/cinder/conversion/vol_upload_u8r2bsb9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:52 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img /opt/stack/data/cinder/conversion/vol_upload_u8r2bsb9
Aug 04 09:32:52 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:52 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img /opt/stack/data/cinder/conversion/vol_upload_u8r2bsb9" returned: 0 in 0.277s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:52 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Image conversion details: src /opt/stack/data/cinder/conversion/b186fa55-1289-43ac-8b38-75a764df88c6.temp_image.a97ddbef-cc5a-4856-83b1-cd6f498c5e58luh0cm0t.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_u8r2bsb9 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:32:52 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Converted 1024.00 MB image at 1024.00 MB/s
Aug 04 09:32:52 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[238de881-760a-46f0-882d-49241379039d]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8r2bsb9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:52 devstack sudo[105606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8r2bsb9
Aug 04 09:32:52 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:52 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8r2bsb9" returned: 0 in 0.334s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.895s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:32:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Uploaded volume to glance image-id: a97ddbef-cc5a-4856-83b1-cd6f498c5e58. {{(pid=88880) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 04 09:32:54 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d2916e3e-0718-4688-8ef6-552f11e09bbd tempest-VolumesActionsTest-39635361 None] Copy volume to image completed successfully.
Aug 04 09:32:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Acquiring lock "cinder-5c54e999-0c4c-4158-9f76-f5e4ae5821b2-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "cinder-5c54e999-0c4c-4158-9f76-f5e4ae5821b2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Acquiring lock "cinder-quobyte-5c54e999-0c4c-4158-9f76-f5e4ae5821b2" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "cinder-quobyte-5c54e999-0c4c-4158-9f76-f5e4ae5821b2" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:54 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2824a59-13ad-49a5-9ec5-8badbad24e37]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:54 devstack sudo[105617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2
Aug 04 09:32:54 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:55 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2" returned: 0 in 0.411s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:55 devstack sudo[105622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2
Aug 04 09:32:55 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:55 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c54e999-0c4c-4158-9f76-f5e4ae5821b2" returned: 0 in 0.267s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "cinder-quobyte-5c54e999-0c4c-4158-9f76-f5e4ae5821b2" released by "delete_volume" :: held 0.725s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Created reservations ['19ff9e9c-088c-4de8-a37c-63cdeeac847e', '5945f50e-a464-4f67-8166-4f78645dff77', '41ab708b-9916-42fc-a010-67015b4a7f47', '780dc929-f0a9-48dc-8420-5163417859c2'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Acquiring lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:55 devstack sudo[105625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:32:55 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Acquiring lock "cinder-quobyte-b186fa55-1289-43ac-8b38-75a764df88c6" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Lock "cinder-quobyte-b186fa55-1289-43ac-8b38-75a764df88c6" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fe0c62-ae60-47e3-a491-25101bbf33da]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:55 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6
Aug 04 09:32:55 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Acquiring lock "cinder-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:55 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.279s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:32:55 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Deleted volume successfully.
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "cinder-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3a21b257-1034-4a8f-9cce-b9d660d90df2 tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "cinder-5c54e999-0c4c-4158-9f76-f5e4ae5821b2-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Acquiring lock "cinder-quobyte-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "cinder-quobyte-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff444bd-4a9f-4348-b6b2-95c3a2577582]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:55 devstack sudo[105630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5
Aug 04 09:32:55 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:55 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6" returned: 0 in 0.391s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:55 devstack sudo[105635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6
Aug 04 09:32:55 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:56 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b186fa55-1289-43ac-8b38-75a764df88c6" returned: 0 in 0.241s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:56 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5" returned: 0 in 0.373s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Lock "cinder-quobyte-b186fa55-1289-43ac-8b38-75a764df88c6" released by "delete_volume" :: held 0.682s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:56 devstack sudo[105641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5
Aug 04 09:32:56 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Created reservations ['6424d4f7-4cb2-40e5-b77f-fbce4172e981', 'fa8355f9-1267-4e06-9eb0-52c40406b650', '65dff047-2a68-4b32-92dc-647f55e22ed0', '35cfbc3c-48cb-4e5d-aa70-ea5da396c58e'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:56 devstack sudo[105643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:32:56 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:56 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5" returned: 0 in 0.250s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "cinder-quobyte-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5" released by "delete_volume" :: held 0.662s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Created reservations ['a8b27a03-741c-4ede-9b4b-d9f26e0c7349', '5f532078-a1a7-48cc-9457-7002fbe5cbef', '1bd1f361-a007-40dd-9b44-bfe0b9b5a4f9', 'c70bd06c-5f61-49a2-b27b-bf08bba76c26'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:32:56 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.291s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:32:56 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Deleted volume successfully.
Aug 04 09:32:56 devstack sudo[105647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:32:56 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-10b249eb-823a-4990-a8a1-9aa5a34f7270 tempest-VolumesActionsTest-39635361 None] Lock "cinder-b186fa55-1289-43ac-8b38-75a764df88c6-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:32:56 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.337s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:32:56 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:32:57 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Deleted volume successfully.
Aug 04 09:32:57 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fde00f9c-a123-4742-9599-5158fe15252b tempest-TestServerVolumeAttachmentScenario-1248602601 None] Lock "cinder-68e9bc1c-6bbc-4c54-b92a-c83e7a0925e5-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Flow 'volume_create_manager' (f6ac5edf-6583-4594-9b36-b8ebeea85571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a85ca39-ee1e-4ffb-8362-090aa0723cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a85ca39-ee1e-4ffb-8362-090aa0723cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-323616217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b2b8d3-45a2-41c1-b693-a644694b1e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dbabee0bade4761ae14a9099a75e2b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:33:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:33:03Z,use_quota=True,user_id='b8bc1d3140e94b428abfb930f3f82b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743493a9-fa92-4725-b1a6-d3eccdf6c1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743493a9-fa92-4725-b1a6-d3eccdf6c1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e13d46-5d4f-4bd7-90e3-ec3981ca44f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e13d46-5d4f-4bd7-90e3-ec3981ca44f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b2b8d3-45a2-41c1-b693-a644694b1e7f', 'volume_name': 'volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f', 'volume_size': 2}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4997cc-335d-4c20-8b73-824b8ba7c51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4997cc-335d-4c20-8b73-824b8ba7c51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13b0eda-c4bf-4247-93f8-da5ff98fb3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:03 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Volume 09b2b8d3-45a2-41c1-b693-a644694b1e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f', 'volume_size': 2}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-323616217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b2b8d3-45a2-41c1-b693-a644694b1e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dbabee0bade4761ae14a9099a75e2b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:33:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:33:03Z,use_quota=True,user_id='b8bc1d3140e94b428abfb930f3f82b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Creating volume 09b2b8d3-45a2-41c1-b693-a644694b1e7f {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:33:03 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:33:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f 2147483648 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:03 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f 2147483648
Aug 04 09:33:03 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:04 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f 2147483648" returned: 0 in 0.507s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:04 devstack sudo[105662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f
Aug 04 09:33:04 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:04 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f" returned: 0 in 0.311s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:33:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:33:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13b0eda-c4bf-4247-93f8-da5ff98fb3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f', 'volume_size': 2}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c697c5-feeb-4302-890a-46d17f06a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:04 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Volume volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f (09b2b8d3-45a2-41c1-b693-a644694b1e7f): created successfully
Aug 04 09:33:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c697c5-feeb-4302-890a-46d17f06a300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:04 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Flow 'volume_create_manager' (f6ac5edf-6583-4594-9b36-b8ebeea85571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:33:04 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2296549b-15b6-4c6b-893c-ca6b064b8d43 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Created volume successfully.
Aug 04 09:33:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:33:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:33:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Creating offline snapshot 4e76c112-b38d-45cc-b64f-ab778571c21d of volume 09b2b8d3-45a2-41c1-b693-a644694b1e7f {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:33:05 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4781f579-fe49-4428-9e79-25e428169993]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:33:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:05 devstack sudo[105666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f
Aug 04 09:33:05 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:06 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f" returned: 0 in 0.373s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d 2G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:06 devstack sudo[105671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d 2G
Aug 04 09:33:06 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:06 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d 2G" returned: 0 in 0.450s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:06 devstack sudo[105677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d
Aug 04 09:33:06 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:06 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d" returned: 0 in 0.290s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:06 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d is being set with open permissions: ugo+rw
Aug 04 09:33:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:06 devstack sudo[105683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d
Aug 04 09:33:06 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:07 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d" returned: 0 in 0.241s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:07 devstack sudo[105686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.info
Aug 04 09:33:07 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:07 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.info" returned: 0 in 0.245s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:07 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.info is being set with open permissions: ugo+rw
Aug 04 09:33:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:07 devstack sudo[105689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.info
Aug 04 09:33:07 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:07 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.info" returned: 0 in 0.268s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:33:07 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b4a4bdbd-e159-43ee-9238-d12300a6a4d9 tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Create snapshot completed successfully
Aug 04 09:33:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Acquiring lock "cinder-4e76c112-b38d-45cc-b64f-ab778571c21d-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "cinder-4e76c112-b38d-45cc-b64f-ab778571c21d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Acquiring lock "cinder-quobyte-09b2b8d3-45a2-41c1-b693-a644694b1e7f" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "cinder-quobyte-09b2b8d3-45a2-41c1-b693-a644694b1e7f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Acquiring lock "cinder-quobyte-4e76c112-b38d-45cc-b64f-ab778571c21d" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "cinder-quobyte-4e76c112-b38d-45cc-b64f-ab778571c21d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Deleting offline snapshot 4e76c112-b38d-45cc-b64f-ab778571c21d of volume 09b2b8d3-45a2-41c1-b693-a644694b1e7f {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] snapshot_file for this snap is: volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3468290-3f22-428d-a03d-b1a6fdcd8b39]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:08 devstack sudo[105693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:33:08 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:08 devstack sudo[105692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d
Aug 04 09:33:08 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:08 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.253s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:33:08 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d" returned: 0 in 0.413s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc9abcd-efd9-4d0d-aea6-59a773d8489f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:08 devstack sudo[105700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f
Aug 04 09:33:08 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:08 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f" returned: 0 in 0.397s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:08 devstack sudo[105705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d
Aug 04 09:33:08 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:09 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d" returned: 0 in 0.341s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:09 devstack sudo[105710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d
Aug 04 09:33:09 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:09 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f.4e76c112-b38d-45cc-b64f-ab778571c21d" returned: 0 in 0.246s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "cinder-quobyte-4e76c112-b38d-45cc-b64f-ab778571c21d" released by "_delete_snapshot" :: held 1.515s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:33:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "cinder-quobyte-09b2b8d3-45a2-41c1-b693-a644694b1e7f" released by "delete_snapshot" :: held 1.543s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:33:09 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Created reservations ['92aa95e0-f55e-4520-bda3-74ee88f99bc9', '5e69f779-8a25-4404-a0ef-8b475596afd7', '487e51b4-70cf-45e5-89c4-f59170648b56', '1ae5741e-0e83-445d-94c7-b932f7cc9c09'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:33:09 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Delete snapshot completed successfully.
Aug 04 09:33:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1251a20a-df57-4e29-9e70-ffb899dac8ad tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "cinder-4e76c112-b38d-45cc-b64f-ab778571c21d-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:33:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Acquiring lock "cinder-09b2b8d3-45a2-41c1-b693-a644694b1e7f-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:33:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "cinder-09b2b8d3-45a2-41c1-b693-a644694b1e7f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:33:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Acquiring lock "cinder-quobyte-09b2b8d3-45a2-41c1-b693-a644694b1e7f" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:33:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "cinder-quobyte-09b2b8d3-45a2-41c1-b693-a644694b1e7f" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:33:10 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7212a8cd-634c-48e7-90c2-7f7c956401a7]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:33:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:10 devstack sudo[105714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f
Aug 04 09:33:10 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:10 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f" returned: 0 in 0.363s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:10 devstack sudo[105719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f
Aug 04 09:33:10 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:10 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-09b2b8d3-45a2-41c1-b693-a644694b1e7f" returned: 0 in 0.250s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "cinder-quobyte-09b2b8d3-45a2-41c1-b693-a644694b1e7f" released by "delete_volume" :: held 0.674s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:33:11 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Created reservations ['15dba61a-6da0-4f46-84f3-2521a3ae2f9a', '3ef2878b-5163-425c-ac21-154e13b1b4f0', 'cfd422e9-013c-4c1a-8e4c-3cb265252e89', 'f2d1b0ec-d3e9-442f-b88d-61861b26fdf8'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:33:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:33:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:33:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:33:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:33:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:33:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:11 devstack sudo[105722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:33:11 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:11 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.260s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:11 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:33:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Deleted volume successfully.
Aug 04 09:33:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6fd14ebc-2c74-4adf-9c80-c798772c25be tempest-VolumesSnapshotNegativeTestJSON-864981367 None] Lock "cinder-09b2b8d3-45a2-41c1-b693-a644694b1e7f-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:33:21 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=46,cinder:UPDATE=39,cinder:INSERT=11,cinder:DELETE=1 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:33:21 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=50,cinder:SELECT=34,cinder:INSERT=11,cinder:DELETE=5 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:33:32 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:33:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Flow 'volume_create_manager' (dcc8d4be-dc5b-4afb-a227-e92a28850f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:33:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd86d132-f802-4fac-b714-9fa4cd233a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd86d132-f802-4fac-b714-9fa4cd233a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-410280529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7badf4e-34bc-480f-9e99-71651799e760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f436aec7b74570a38adf600e640a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:33:33Z,use_quota=True,user_id='074cc964610d4f6a9c2e36e1bd9eba7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c40f5cd-b547-4c1a-b82b-5dd296603a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c40f5cd-b547-4c1a-b82b-5dd296603a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b681247d-0372-4171-8f41-754fa4e06651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:32 devstack cinder-volume[88880]: DEBUG cinder.image.glance [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Creating Keystone auth plugin from conf {{(pid=88880) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 04 09:33:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b681247d-0372-4171-8f41-754fa4e06651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7badf4e-34bc-480f-9e99-71651799e760', 'volume_name': 'volume-c7badf4e-34bc-480f-9e99-71651799e760', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba56b3e0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2b349e-d336-4b5c-888a-ba6587f7cbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2b349e-d336-4b5c-888a-ba6587f7cbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af279819-fc83-4d77-b9c0-1e663536e6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:33 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Volume c7badf4e-34bc-480f-9e99-71651799e760: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7badf4e-34bc-480f-9e99-71651799e760', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba56b3e0>}
Aug 04 09:33:33 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Trying to clone c7badf4e-34bc-480f-9e99-71651799e760 from image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]). {{(pid=88880) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 04 09:33:33 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 04 09:33:33 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Image download 20.69 MB at 20.69 MB/s
Aug 04 09:33:33 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c31d3a4-4500-4c89-8390-3578e8a9067b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:33:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:33 devstack sudo[105732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD
Aug 04 09:33:33 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:33 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:33 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Temporary image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 is fetched for user 074cc964610d4f6a9c2e36e1bd9eba7c. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 04 09:33:33 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c6758c-742a-4ad6-82a1-4e129efb2414]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:33:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:34 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD
Aug 04 09:33:34 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:34 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-410280529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7badf4e-34bc-480f-9e99-71651799e760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f436aec7b74570a38adf600e640a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:33:33Z,use_quota=True,user_id='074cc964610d4f6a9c2e36e1bd9eba7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Creating volume c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:33:34 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:34 devstack sudo[105743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 1073741824
Aug 04 09:33:34 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:34 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 1073741824" returned: 0 in 0.481s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:34 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760
Aug 04 09:33:34 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:35 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760" returned: 0 in 0.248s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:33:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:33:35 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Attempting download of 3846a4df-9a56-4b6a-83ff-12d6b09a1144 ((None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}])) to volume c7badf4e-34bc-480f-9e99-71651799e760. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 04 09:33:35 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dead10-c0b4-4c7a-9c25-8b2aac68aa87]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:33:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_cav48n34 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:35 devstack sudo[105752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_cav48n34
Aug 04 09:33:35 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:35 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_cav48n34" returned: 0 in 0.333s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_cav48n34 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:35 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_cav48n34
Aug 04 09:33:35 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:35 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_cav48n34" returned: 1 in 0.347s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3846a4df-9a56-4b6a-83ff-12d6b09a1144_cav48n34' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:33:35 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e3cea7-6855-45ab-bfae-9972791cfa62]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:33:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:35 devstack sudo[105760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD
Aug 04 09:33:35 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:36 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:36 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] 3846a4df-9a56-4b6a-83ff-12d6b09a1144 was qcow2, converting to raw {{(pid=88880) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 04 09:33:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:36 devstack sudo[105765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760
Aug 04 09:33:36 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:37 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760" returned: 0 in 1.785s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:37 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3846a4df-9a56-4b6a-83ff-12d6b09a1144_pdkezn6odevstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:33:37 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Converted 112.00 MB image at 62.71 MB/s
Aug 04 09:33:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:38 devstack sudo[105773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 1G
Aug 04 09:33:38 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:38 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 1G" returned: 0 in 0.294s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:38 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7683ec0-08a8-4205-8b68-58b95b686427]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:33:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:38 devstack sudo[105778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760
Aug 04 09:33:38 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:38 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760" returned: 0 in 0.358s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:38 devstack sudo[105782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760
Aug 04 09:33:38 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:39 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760" returned: 1 in 0.354s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:33:39 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Downloaded image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 ((None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}])) to volume c7badf4e-34bc-480f-9e99-71651799e760 successfully. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 04 09:33:39 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Temporary image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 for user 074cc964610d4f6a9c2e36e1bd9eba7c is deleted. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 04 09:33:39 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Marking volume c7badf4e-34bc-480f-9e99-71651799e760 as bootable. {{(pid=88880) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 04 09:33:39 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Copying metadata from image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 to c7badf4e-34bc-480f-9e99-71651799e760. {{(pid=88880) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 04 09:33:39 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Creating volume glance metadata for volume c7badf4e-34bc-480f-9e99-71651799e760 backed by image 3846a4df-9a56-4b6a-83ff-12d6b09a1144 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88880) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 04 09:33:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af279819-fc83-4d77-b9c0-1e663536e6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7badf4e-34bc-480f-9e99-71651799e760', 'volume_size': 1, 'image_id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d05f65ba7f04d218668a31cb0b3eb4a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3846a4df-9a56-4b6a-83ff-12d6b09a1144', 'created_at': datetime.datetime(2026, 8, 4, 7, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 13, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3846a4df-9a56-4b6a-83ff-12d6b09a1144/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba56b3e0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df6d44a-ed50-4b3d-8f35-4837d5d7686d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:39 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Volume volume-c7badf4e-34bc-480f-9e99-71651799e760 (c7badf4e-34bc-480f-9e99-71651799e760): created successfully
Aug 04 09:33:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df6d44a-ed50-4b3d-8f35-4837d5d7686d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Flow 'volume_create_manager' (dcc8d4be-dc5b-4afb-a227-e92a28850f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:33:39 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-13ca6e14-4d4b-453a-9de1-d302bc5e80bf tempest-TestShelveInstance-926060812 None] Created volume successfully.
Aug 04 09:33:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-465047d7-c1a7-4ba5-bea2-0e4ec886271d req-f73a5586-b20a-4f9c-a301-45f180cae5ce tempest-TestShelveInstance-926060812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:33:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-465047d7-c1a7-4ba5-bea2-0e4ec886271d req-f73a5586-b20a-4f9c-a301-45f180cae5ce tempest-TestShelveInstance-926060812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:33:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[760083a0-8411-4763-9632-3c45db190d41]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:33:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-465047d7-c1a7-4ba5-bea2-0e4ec886271d req-f73a5586-b20a-4f9c-a301-45f180cae5ce tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:42 devstack sudo[105802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760
Aug 04 09:33:42 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:43 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-465047d7-c1a7-4ba5-bea2-0e4ec886271d req-f73a5586-b20a-4f9c-a301-45f180cae5ce tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760" returned: 0 in 0.480s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-465047d7-c1a7-4ba5-bea2-0e4ec886271d req-f73a5586-b20a-4f9c-a301-45f180cae5ce tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:43 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760
Aug 04 09:33:43 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:43 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-465047d7-c1a7-4ba5-bea2-0e4ec886271d req-f73a5586-b20a-4f9c-a301-45f180cae5ce tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760" returned: 1 in 0.564s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-465047d7-c1a7-4ba5-bea2-0e4ec886271d req-f73a5586-b20a-4f9c-a301-45f180cae5ce tempest-TestShelveInstance-926060812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:33:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-465047d7-c1a7-4ba5-bea2-0e4ec886271d req-f73a5586-b20a-4f9c-a301-45f180cae5ce tempest-TestShelveInstance-926060812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.108s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:33:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-465047d7-c1a7-4ba5-bea2-0e4ec886271d req-f73a5586-b20a-4f9c-a301-45f180cae5ce tempest-TestShelveInstance-926060812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-c7badf4e-34bc-480f-9e99-71651799e760', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ce15450-dfc5-42c5-90d6-0ae22af53fdf', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:33:43 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-465047d7-c1a7-4ba5-bea2-0e4ec886271d req-f73a5586-b20a-4f9c-a301-45f180cae5ce tempest-TestShelveInstance-926060812 None] attachment_update completed successfully.
Aug 04 09:33:53 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Flow 'volume_create_manager' (0fbe6093-904b-49c0-9f8a-90022c2fe65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739b8648-6a63-4457-8fb6-82465da2b38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739b8648-6a63-4457-8fb6-82465da2b38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1314866562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f0bc2a-811f-424f-8c62-9ad482ffe05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54313bec51484aebbf81f9da188174c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:33:54Z,use_quota=True,user_id='8a09fd2c847a44228b29c44b911f63d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2e8730-a3a6-4a55-8227-13bfa5625633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2e8730-a3a6-4a55-8227-13bfa5625633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa1e7ac-c3d0-4acf-a143-8170ce05b274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa1e7ac-c3d0-4acf-a143-8170ce05b274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f0bc2a-811f-424f-8c62-9ad482ffe05c', 'volume_name': 'volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69993864-d877-4ec6-b7a7-ef6cfe070bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69993864-d877-4ec6-b7a7-ef6cfe070bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a94228-0529-49a1-a778-3b9a94e18423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:54 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Volume 64f0bc2a-811f-424f-8c62-9ad482ffe05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c', 'volume_size': 1}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1314866562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f0bc2a-811f-424f-8c62-9ad482ffe05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54313bec51484aebbf81f9da188174c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:33:54Z,use_quota=True,user_id='8a09fd2c847a44228b29c44b911f63d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Creating volume 64f0bc2a-811f-424f-8c62-9ad482ffe05c {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:33:54 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:54 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c 1073741824
Aug 04 09:33:54 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:54 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c 1073741824" returned: 0 in 0.585s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:54 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c
Aug 04 09:33:54 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:55 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c" returned: 0 in 0.400s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:33:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:33:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a94228-0529-49a1-a778-3b9a94e18423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6934f669-48df-4f60-9934-320ed6891843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:33:55 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Volume volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c (64f0bc2a-811f-424f-8c62-9ad482ffe05c): created successfully
Aug 04 09:33:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6934f669-48df-4f60-9934-320ed6891843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:33:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Flow 'volume_create_manager' (0fbe6093-904b-49c0-9f8a-90022c2fe65b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:33:55 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f15c5767-59d7-44d1-8801-5fe46d3886d4 tempest-TestMinimumBasicScenario-1478115159 None] Created volume successfully.
Aug 04 09:33:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-15d56726-ef3c-49fe-a3f5-2637624c343a req-4a742cc9-5eb4-4440-bb62-8578fea6e293 tempest-TestMinimumBasicScenario-1478115159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:33:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-15d56726-ef3c-49fe-a3f5-2637624c343a req-4a742cc9-5eb4-4440-bb62-8578fea6e293 tempest-TestMinimumBasicScenario-1478115159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:33:57 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c5a2eb-b7b5-44b9-bded-a2190318bb5f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:33:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-15d56726-ef3c-49fe-a3f5-2637624c343a req-4a742cc9-5eb4-4440-bb62-8578fea6e293 tempest-TestMinimumBasicScenario-1478115159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:33:57 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c
Aug 04 09:33:57 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:33:57 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Aug 04 09:33:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-15d56726-ef3c-49fe-a3f5-2637624c343a req-4a742cc9-5eb4-4440-bb62-8578fea6e293 tempest-TestMinimumBasicScenario-1478115159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c" returned: 0 in 0.380s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:33:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-15d56726-ef3c-49fe-a3f5-2637624c343a req-4a742cc9-5eb4-4440-bb62-8578fea6e293 tempest-TestMinimumBasicScenario-1478115159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.398s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:33:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-15d56726-ef3c-49fe-a3f5-2637624c343a req-4a742cc9-5eb4-4440-bb62-8578fea6e293 tempest-TestMinimumBasicScenario-1478115159 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b81cd65c-0719-466d-93d0-fa098ccc026f', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:33:57 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-15d56726-ef3c-49fe-a3f5-2637624c343a req-4a742cc9-5eb4-4440-bb62-8578fea6e293 tempest-TestMinimumBasicScenario-1478115159 None] attachment_update completed successfully.
Aug 04 09:34:07 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=15,cinder:SELECT=27,cinder:INSERT=11 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:34:07 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=19,cinder:UPDATE=7,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:34:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:34:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:34:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:34:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:34:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:34:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:34:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:34:08 devstack sudo[106579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:34:08 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:34:08 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root
Aug 04 09:34:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.236s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:34:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:34:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:34:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:34:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:34:18 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-a6a3b003-5db9-4b8a-9aa2-4587a17705f4 req-96d245c4-df90-4c23-9f28-f52b2937a984 tempest-TestShelveInstance-926060812 None] Terminate volume connection completed successfully.
Aug 04 09:34:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-a6a3b003-5db9-4b8a-9aa2-4587a17705f4 req-96d245c4-df90-4c23-9f28-f52b2937a984 tempest-TestShelveInstance-926060812 None] Deleting attachment 9ce15450-dfc5-42c5-90d6-0ae22af53fdf. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:34:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-58bf00af-08dc-4287-a8d4-be88da32b004 req-164faeb7-34d5-424d-b86d-20cf4e648d09 tempest-TestShelveInstance-926060812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:34:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-58bf00af-08dc-4287-a8d4-be88da32b004 req-164faeb7-34d5-424d-b86d-20cf4e648d09 tempest-TestShelveInstance-926060812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:34:19 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[484d84e2-3b37-4dea-89df-dbe5d62f2cc2]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:34:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-58bf00af-08dc-4287-a8d4-be88da32b004 req-164faeb7-34d5-424d-b86d-20cf4e648d09 tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:34:20 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760
Aug 04 09:34:20 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:34:20 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Aug 04 09:34:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-58bf00af-08dc-4287-a8d4-be88da32b004 req-164faeb7-34d5-424d-b86d-20cf4e648d09 tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760" returned: 0 in 0.388s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:34:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-58bf00af-08dc-4287-a8d4-be88da32b004 req-164faeb7-34d5-424d-b86d-20cf4e648d09 tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:34:20 devstack sudo[106682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760
Aug 04 09:34:20 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:34:20 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root
Aug 04 09:34:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-58bf00af-08dc-4287-a8d4-be88da32b004 req-164faeb7-34d5-424d-b86d-20cf4e648d09 tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760" returned: 1 in 0.346s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:34:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-58bf00af-08dc-4287-a8d4-be88da32b004 req-164faeb7-34d5-424d-b86d-20cf4e648d09 tempest-TestShelveInstance-926060812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:34:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-58bf00af-08dc-4287-a8d4-be88da32b004 req-164faeb7-34d5-424d-b86d-20cf4e648d09 tempest-TestShelveInstance-926060812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.781s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:34:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-58bf00af-08dc-4287-a8d4-be88da32b004 req-164faeb7-34d5-424d-b86d-20cf4e648d09 tempest-TestShelveInstance-926060812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-c7badf4e-34bc-480f-9e99-71651799e760', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70a71e9d-1ed2-4a34-b001-21c4c4555ac5', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:34:20 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-58bf00af-08dc-4287-a8d4-be88da32b004 req-164faeb7-34d5-424d-b86d-20cf4e648d09 tempest-TestShelveInstance-926060812 None] attachment_update completed successfully.
Aug 04 09:34:30 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=7 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:34:30 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:34:43 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-f257438e-af13-46eb-b775-6060e50efb7f req-36d43bd5-33af-487a-a01a-61e3a3ab8d4f tempest-TestMinimumBasicScenario-1478115159 None] Terminate volume connection completed successfully.
Aug 04 09:34:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-f257438e-af13-46eb-b775-6060e50efb7f req-36d43bd5-33af-487a-a01a-61e3a3ab8d4f tempest-TestMinimumBasicScenario-1478115159 None] Deleting attachment b81cd65c-0719-466d-93d0-fa098ccc026f. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:34:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Acquiring lock "cinder-64f0bc2a-811f-424f-8c62-9ad482ffe05c-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:34:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Lock "cinder-64f0bc2a-811f-424f-8c62-9ad482ffe05c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:34:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Acquiring lock "cinder-quobyte-64f0bc2a-811f-424f-8c62-9ad482ffe05c" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:34:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Lock "cinder-quobyte-64f0bc2a-811f-424f-8c62-9ad482ffe05c" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:34:44 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed23a9bb-7a32-42c7-ac6d-619e55aa48cb]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:34:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:34:44 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c
Aug 04 09:34:44 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:34:45 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c" returned: 0 in 0.342s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:34:45 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c
Aug 04 09:34:45 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:34:45 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-64f0bc2a-811f-424f-8c62-9ad482ffe05c" returned: 0 in 0.231s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Lock "cinder-quobyte-64f0bc2a-811f-424f-8c62-9ad482ffe05c" released by "delete_volume" :: held 0.611s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Created reservations ['f545f010-ffa7-47a3-b05b-3958e5702f3b', 'ad075646-52df-46dd-b17a-663322147abd', 'd72a58db-af23-4d63-adf3-5aff7d2e4c9b', '68ca3d51-439c-4030-b1ef-33b2da069f38'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:34:45 devstack sudo[106831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:34:45 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:34:45 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.268s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:34:45 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Deleted volume successfully.
Aug 04 09:34:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b7cf0135-1b89-45f7-8627-c02610ca96fe tempest-TestMinimumBasicScenario-1478115159 None] Lock "cinder-64f0bc2a-811f-424f-8c62-9ad482ffe05c-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:34:51 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-89aad519-4dc2-4fc9-973d-c32191bf66ad tempest-TestShelveInstance-926060812 None] Terminate volume connection completed successfully.
Aug 04 09:34:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-89aad519-4dc2-4fc9-973d-c32191bf66ad tempest-TestShelveInstance-926060812 None] Deleting attachment 70a71e9d-1ed2-4a34-b001-21c4c4555ac5. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:34:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Acquiring lock "cinder-c7badf4e-34bc-480f-9e99-71651799e760-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:34:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Lock "cinder-c7badf4e-34bc-480f-9e99-71651799e760-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:34:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Acquiring lock "cinder-quobyte-c7badf4e-34bc-480f-9e99-71651799e760" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:34:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Lock "cinder-quobyte-c7badf4e-34bc-480f-9e99-71651799e760" acquired by "delete_volume" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:34:52 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd275f3f-5ad7-405a-9cc6-5c59fda0d6cc]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:34:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:34:52 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760
Aug 04 09:34:52 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:34:52 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Aug 04 09:34:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760" returned: 0 in 0.428s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:34:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:34:52 devstack sudo[106900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760
Aug 04 09:34:52 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:34:53 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760" returned: 1 in 0.419s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:34:53 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760
Aug 04 09:34:53 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:34:53 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c7badf4e-34bc-480f-9e99-71651799e760" returned: 0 in 0.330s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Lock "cinder-quobyte-c7badf4e-34bc-480f-9e99-71651799e760" released by "delete_volume" :: held 1.263s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG cinder.quota [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Created reservations ['f45efcd9-dfb7-4897-a6e4-8f1ee3c0e117', '0fce82ca-e9fb-4b2c-9404-75abe2b0bb3b', '1364ac91-c659-44e8-b143-4e6e09ad4468', '9ba5e293-e97b-4ac5-b475-cb44e6e7ecdc'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:34:53 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:34:53 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:34:53 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.324s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:34:53 devstack cinder-volume[88880]: DEBUG cinder.manager [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:34:53 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Deleted volume successfully.
Aug 04 09:34:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [req-74ba4408-7885-4d4d-880c-68f6b108a988 req-83964a6c-e466-4d78-b87a-120eee12da9f tempest-TestShelveInstance-926060812 None] Lock "cinder-c7badf4e-34bc-480f-9e99-71651799e760-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:35:03 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=21 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:35:03 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=13,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:35:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:35:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:35:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:35:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:35:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:35:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:35:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:35:08 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:35:08 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:35:08 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Aug 04 09:35:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.255s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:35:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:35:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:35:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:35:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:35:24 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:35:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Flow 'volume_create_manager' (8f0ac2a8-fbd8-4937-9640-7c0efd3af6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:35:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d292c17-ce98-4406-84c5-10fa72232561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:35:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d292c17-ce98-4406-84c5-10fa72232561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1380396091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f933215f-bd6b-4670-8c7c-057bb2e5314a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe05bf25a1fc4ea391eeb7d11553544f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:35:25Z,use_quota=True,user_id='33fa41943d85477fae0b96c296aa1754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:35:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837622b3-b285-4698-81a7-0027a48821e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:35:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837622b3-b285-4698-81a7-0027a48821e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc346ccc-22ac-4b57-a270-73226356c74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc346ccc-22ac-4b57-a270-73226356c74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f933215f-bd6b-4670-8c7c-057bb2e5314a', 'volume_name': 'volume-f933215f-bd6b-4670-8c7c-057bb2e5314a', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3923c3c-47bf-4828-8858-ac214b8fb8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3923c3c-47bf-4828-8858-ac214b8fb8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b28ee80-a279-4cb6-ad99-f01021bed07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:35:25 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Volume f933215f-bd6b-4670-8c7c-057bb2e5314a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f933215f-bd6b-4670-8c7c-057bb2e5314a', 'volume_size': 1}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1380396091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f933215f-bd6b-4670-8c7c-057bb2e5314a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe05bf25a1fc4ea391eeb7d11553544f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:35:25Z,use_quota=True,user_id='33fa41943d85477fae0b96c296aa1754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Creating volume f933215f-bd6b-4670-8c7c-057bb2e5314a {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:35:25 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:35:25 devstack sudo[106937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a 1073741824
Aug 04 09:35:25 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:35:25 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a 1073741824" returned: 0 in 0.497s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:35:25 devstack sudo[106944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a
Aug 04 09:35:25 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:35:25 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a" returned: 0 in 0.271s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b28ee80-a279-4cb6-ad99-f01021bed07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f933215f-bd6b-4670-8c7c-057bb2e5314a', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a220fc90-2ae4-471e-8897-d8129492967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:35:25 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Volume volume-f933215f-bd6b-4670-8c7c-057bb2e5314a (f933215f-bd6b-4670-8c7c-057bb2e5314a): created successfully
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a220fc90-2ae4-471e-8897-d8129492967f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:35:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Flow 'volume_create_manager' (8f0ac2a8-fbd8-4937-9640-7c0efd3af6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:35:25 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-73c1893e-6715-4559-b394-886c9729e013 tempest-TestStampPattern-11892702 None] Created volume successfully.
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Flow 'volume_create_manager' (ccfa1fda-e82c-409d-aa2e-dc0e4a476823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df036941-1c5f-4f21-9f36-18833d9f33b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df036941-1c5f-4f21-9f36-18833d9f33b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-125650754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab63ea8c-0bce-4e76-b695-58d40086f960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c718073d044be983dd86a178283f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:35:33Z,use_quota=True,user_id='1614b929a19540a6bd8b86a09f47d3bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55473ffb-8ffd-4055-8e1e-e27e8a812222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55473ffb-8ffd-4055-8e1e-e27e8a812222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37109a8-a451-45cd-befe-01cbc4891067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37109a8-a451-45cd-befe-01cbc4891067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab63ea8c-0bce-4e76-b695-58d40086f960', 'volume_name': 'volume-ab63ea8c-0bce-4e76-b695-58d40086f960', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f803333b-5899-4161-a365-2df6615e2574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f803333b-5899-4161-a365-2df6615e2574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb29470-81d6-42e1-a397-5fb61e5fe6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:35:33 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Volume ab63ea8c-0bce-4e76-b695-58d40086f960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab63ea8c-0bce-4e76-b695-58d40086f960', 'volume_size': 1}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-125650754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab63ea8c-0bce-4e76-b695-58d40086f960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c718073d044be983dd86a178283f70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:35:33Z,use_quota=True,user_id='1614b929a19540a6bd8b86a09f47d3bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Creating volume ab63ea8c-0bce-4e76-b695-58d40086f960 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:35:33 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:35:33 devstack sudo[107054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960 1073741824
Aug 04 09:35:33 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:35:33 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960 1073741824" returned: 0 in 0.508s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:35:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:35:34 devstack sudo[107059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960
Aug 04 09:35:34 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:35:34 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root
Aug 04 09:35:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960" returned: 0 in 0.285s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:35:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:35:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:35:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb29470-81d6-42e1-a397-5fb61e5fe6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab63ea8c-0bce-4e76-b695-58d40086f960', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:35:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d082705a-2895-4026-adad-43ed0def6029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:35:34 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Volume volume-ab63ea8c-0bce-4e76-b695-58d40086f960 (ab63ea8c-0bce-4e76-b695-58d40086f960): created successfully
Aug 04 09:35:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d082705a-2895-4026-adad-43ed0def6029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:35:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Flow 'volume_create_manager' (ccfa1fda-e82c-409d-aa2e-dc0e4a476823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:35:34 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ba31cda5-9839-4b3c-8355-b5117d2a1382 tempest-TestImageHashVerification-1174204626 None] Created volume successfully.
Aug 04 09:35:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:35:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:35:36 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ec8d62-f646-4dd5-a951-5f30ac55218e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:35:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:35:36 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960
Aug 04 09:35:36 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:35:36 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Aug 04 09:35:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960" returned: 0 in 0.380s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:35:36 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6432cf-7ed0-48b8-98b5-bb3715ece0db]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:35:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:35:37 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960
Aug 04 09:35:37 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:35:37 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Aug 04 09:35:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960" returned: 0 in 0.345s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:35:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960 /opt/stack/data/cinder/conversion/ab63ea8c-0bce-4e76-b695-58d40086f960.temp_image.9ad96fbc-3c72-4589-a7d3-3042c819934e_u9nsn2k.img {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:35:37 devstack sudo[107074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960 /opt/stack/data/cinder/conversion/ab63ea8c-0bce-4e76-b695-58d40086f960.temp_image.9ad96fbc-3c72-4589-a7d3-3042c819934e_u9nsn2k.img
Aug 04 09:35:37 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:35:42 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root
Aug 04 09:35:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960 /opt/stack/data/cinder/conversion/ab63ea8c-0bce-4e76-b695-58d40086f960.temp_image.9ad96fbc-3c72-4589-a7d3-3042c819934e_u9nsn2k.img" returned: 0 in 4.674s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:35:42 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5266803a-6f05-4889-b927-54d0e0fbdc84]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:35:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:35:42 devstack sudo[107088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960
Aug 04 09:35:42 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:35:42 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root
Aug 04 09:35:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960" returned: 0 in 0.562s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:35:42 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/conversion/ab63ea8c-0bce-4e76-b695-58d40086f960.temp_image.9ad96fbc-3c72-4589-a7d3-3042c819934e_u9nsn2k.img {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:35:42 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] Converted 1024.00 MB image at 219.01 MB/s
Aug 04 09:35:42 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] 9ad96fbc-3c72-4589-a7d3-3042c819934e was raw, no need to convert to raw {{(pid=88880) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Aug 04 09:35:53 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6,cinder:INSERT=2 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:35:53 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:35:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-0ac6d047-d8bb-4b8e-9fb2-846e680680a5 req-213c61be-e357-4eae-811a-c8eb5574f6e1 tempest-TestStampPattern-11892702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.525s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] Uploaded volume to glance image-id: 9ad96fbc-3c72-4589-a7d3-3042c819934e. {{(pid=88880) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 04 09:36:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-0ac6d047-d8bb-4b8e-9fb2-846e680680a5 req-213c61be-e357-4eae-811a-c8eb5574f6e1 tempest-TestStampPattern-11892702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.305s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:02 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee73ed8-a4d6-4343-a65a-fecbaa945da9]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-0ac6d047-d8bb-4b8e-9fb2-846e680680a5 req-213c61be-e357-4eae-811a-c8eb5574f6e1 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:02 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b258a246-c6bb-4b38-b537-88e2dfc5a1c8 tempest-TestImageHashVerification-1174204626 None] Copy volume to image completed successfully.
Aug 04 09:36:02 devstack sudo[107175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a
Aug 04 09:36:02 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:02 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-0ac6d047-d8bb-4b8e-9fb2-846e680680a5 req-213c61be-e357-4eae-811a-c8eb5574f6e1 tempest-TestStampPattern-11892702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a" returned: 0 in 0.365s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-0ac6d047-d8bb-4b8e-9fb2-846e680680a5 req-213c61be-e357-4eae-811a-c8eb5574f6e1 tempest-TestStampPattern-11892702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.381s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:02 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-0ac6d047-d8bb-4b8e-9fb2-846e680680a5 req-213c61be-e357-4eae-811a-c8eb5574f6e1 tempest-TestStampPattern-11892702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-f933215f-bd6b-4670-8c7c-057bb2e5314a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f43803a-d83d-4a0d-aa58-b3cfe85ceeae', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:36:02 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-0ac6d047-d8bb-4b8e-9fb2-846e680680a5 req-213c61be-e357-4eae-811a-c8eb5574f6e1 tempest-TestStampPattern-11892702 None] attachment_update completed successfully.
Aug 04 09:36:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Acquiring lock "cinder-ab63ea8c-0bce-4e76-b695-58d40086f960-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Lock "cinder-ab63ea8c-0bce-4e76-b695-58d40086f960-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Acquiring lock "cinder-quobyte-ab63ea8c-0bce-4e76-b695-58d40086f960" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Lock "cinder-quobyte-ab63ea8c-0bce-4e76-b695-58d40086f960" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:03 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3763f74-c61b-4209-bed1-ebbda769eba5]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:03 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960
Aug 04 09:36:03 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:03 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960" returned: 0 in 0.383s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:03 devstack sudo[107572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960
Aug 04 09:36:03 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:03 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ab63ea8c-0bce-4e76-b695-58d40086f960" returned: 0 in 0.237s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Lock "cinder-quobyte-ab63ea8c-0bce-4e76-b695-58d40086f960" released by "delete_volume" :: held 0.673s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:04 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Created reservations ['62ba343b-4e5c-411d-9365-927b4a55d5e5', 'c2f4839c-bac8-4678-87ab-43b306fc6890', '97547595-3c9c-4a03-91c5-d3b1b78cc249', '89bed5be-dcec-4eb9-8110-19189ed8d96b'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:36:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:04 devstack sudo[107575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:36:04 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:04 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.259s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:04 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:36:04 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Deleted volume successfully.
Aug 04 09:36:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-35f8eeff-d8a6-40df-9b22-9ecfd0829694 tempest-TestImageHashVerification-1174204626 None] Lock "cinder-ab63ea8c-0bce-4e76-b695-58d40086f960-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:07 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-ae8916cd-1ece-4344-9601-ed2222283739 req-a5830407-c20e-44dc-8b39-04a69d3bb600 tempest-TestStampPattern-11892702 None] Terminate volume connection completed successfully.
Aug 04 09:36:07 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-ae8916cd-1ece-4344-9601-ed2222283739 req-a5830407-c20e-44dc-8b39-04a69d3bb600 tempest-TestStampPattern-11892702 None] Deleting attachment 0f43803a-d83d-4a0d-aa58-b3cfe85ceeae. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:08 devstack sudo[107633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:36:08 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:08 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.268s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] Creating offline snapshot f6fe62de-bc6d-400a-9d19-a6ee153fbf4a of volume f933215f-bd6b-4670-8c7c-057bb2e5314a {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[636c8d86-24f3-4d7e-aec8-f6c7cacd5020]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:08 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a
Aug 04 09:36:08 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:09 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a" returned: 0 in 0.422s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:09 devstack sudo[107642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a 1G
Aug 04 09:36:09 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:09 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a 1G" returned: 0 in 0.458s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f933215f-bd6b-4670-8c7c-057bb2e5314a -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:09 devstack sudo[107647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f933215f-bd6b-4670-8c7c-057bb2e5314a -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a
Aug 04 09:36:09 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:09 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f933215f-bd6b-4670-8c7c-057bb2e5314a -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a" returned: 0 in 0.353s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:09 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a is being set with open permissions: ugo+rw
Aug 04 09:36:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:09 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a
Aug 04 09:36:09 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:10 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a" returned: 0 in 0.246s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:10 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.info
Aug 04 09:36:10 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:10 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.info" returned: 0 in 0.273s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:10 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.info is being set with open permissions: ugo+rw
Aug 04 09:36:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:10 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.info
Aug 04 09:36:10 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:10 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.info" returned: 0 in 0.285s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.141s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:10 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-81fdc661-03f4-45c8-ada1-4cb035b8b334 tempest-TestStampPattern-11892702 None] Create snapshot completed successfully
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Flow 'volume_create_manager' (02f4adb3-d561-4258-b394-8f827e94473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78e82e1-e171-44bf-b0c9-56e941fcbf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78e82e1-e171-44bf-b0c9-56e941fcbf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1335821753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecae993-716d-4043-940a-94a51a03da21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d7902bd5c45dfa9f9636a16ee0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:16Z,use_quota=True,user_id='aed6dc8a44fe4fd8ae770fc8634b654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7656ba93-c026-44f6-8661-8362cb95ed5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7656ba93-c026-44f6-8661-8362cb95ed5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b63012b-eaca-4802-bba5-5247c2b9f6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b63012b-eaca-4802-bba5-5247c2b9f6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ecae993-716d-4043-940a-94a51a03da21', 'volume_name': 'volume-0ecae993-716d-4043-940a-94a51a03da21', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b3f701-9cf2-4ec7-8023-4a6a9f9d323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b3f701-9cf2-4ec7-8023-4a6a9f9d323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6199c0-d562-4c25-801a-7be013d1b369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:16 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume 0ecae993-716d-4043-940a-94a51a03da21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ecae993-716d-4043-940a-94a51a03da21', 'volume_size': 1}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1335821753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecae993-716d-4043-940a-94a51a03da21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d7902bd5c45dfa9f9636a16ee0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:16Z,use_quota=True,user_id='aed6dc8a44fe4fd8ae770fc8634b654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Creating volume 0ecae993-716d-4043-940a-94a51a03da21 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:36:16 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:16 devstack sudo[107697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21 1073741824
Aug 04 09:36:16 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:16 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21 1073741824" returned: 0 in 0.463s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:16 devstack sudo[107703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21
Aug 04 09:36:16 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:16 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21" returned: 0 in 0.259s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6199c0-d562-4c25-801a-7be013d1b369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecae993-716d-4043-940a-94a51a03da21', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b07f241-166c-4d43-a304-b20d4013f352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:16 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume volume-0ecae993-716d-4043-940a-94a51a03da21 (0ecae993-716d-4043-940a-94a51a03da21): created successfully
Aug 04 09:36:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b07f241-166c-4d43-a304-b20d4013f352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Flow 'volume_create_manager' (02f4adb3-d561-4258-b394-8f827e94473d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:17 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3f1c1e8c-a76f-44ae-8950-f4cd03e0c0c7 tempest-CreateVolumesFromSnapshotTest-550363960 None] Created volume successfully.
Aug 04 09:36:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] Creating offline snapshot 77ec9ccc-ff0a-49cd-9a5a-deddc136dbce of volume 0ecae993-716d-4043-940a-94a51a03da21 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:36:17 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f14b3b-7f8e-4ee5-9867-aebcfdb36682]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:17 devstack sudo[107706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21
Aug 04 09:36:17 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21" returned: 0 in 0.481s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:17 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:17 devstack sudo[107713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce 1G
Aug 04 09:36:17 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:18 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce 1G" returned: 0 in 0.481s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecae993-716d-4043-940a-94a51a03da21 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:18 devstack sudo[107719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecae993-716d-4043-940a-94a51a03da21 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce
Aug 04 09:36:18 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Flow 'volume_create_manager' (bee011cc-a995-4ee0-9f70-37fa0274a261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbadd211-a948-4702-80bf-82d658027aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:18 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbadd211-a948-4702-80bf-82d658027aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-416216317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660791ff-f754-4848-a95b-73aa4fa7df90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe05bf25a1fc4ea391eeb7d11553544f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f6fe62de-bc6d-400a-9d19-a6ee153fbf4a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:19Z,use_quota=True,user_id='33fa41943d85477fae0b96c296aa1754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3c86fc-f7d7-4ac0-af92-78c0da15def6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3c86fc-f7d7-4ac0-af92-78c0da15def6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bee454e-237e-4bd5-a2a9-8b74b44504ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bee454e-237e-4bd5-a2a9-8b74b44504ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '660791ff-f754-4848-a95b-73aa4fa7df90', 'volume_name': 'volume-660791ff-f754-4848-a95b-73aa4fa7df90', 'volume_size': 1, 'snapshot_id': 'f6fe62de-bc6d-400a-9d19-a6ee153fbf4a'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f17cffa-b918-4015-babc-786599ed7ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f17cffa-b918-4015-babc-786599ed7ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5c3c65-61dd-4f45-840a-d4744ef5c4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:18 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Volume 660791ff-f754-4848-a95b-73aa4fa7df90: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-660791ff-f754-4848-a95b-73aa4fa7df90', 'volume_size': 1, 'snapshot_id': 'f6fe62de-bc6d-400a-9d19-a6ee153fbf4a'}
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecae993-716d-4043-940a-94a51a03da21 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce" returned: 0 in 0.402s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:18 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce is being set with open permissions: ugo+rw
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:18 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce
Aug 04 09:36:18 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:19 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce" returned: 0 in 0.254s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:19 devstack sudo[107727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.info
Aug 04 09:36:19 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:19 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.info" returned: 0 in 0.252s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:19 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.info is being set with open permissions: ugo+rw
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:19 devstack sudo[107730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.info
Aug 04 09:36:19 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:19 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.info" returned: 0 in 0.306s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.861s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Acquiring lock "cinder-quobyte-f6fe62de-bc6d-400a-9d19-a6ee153fbf4a-660791ff-f754-4848-a95b-73aa4fa7df90" by "_create_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Lock "cinder-quobyte-f6fe62de-bc6d-400a-9d19-a6ee153fbf4a-660791ff-f754-4848-a95b-73aa4fa7df90" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Creating volume 660791ff-f754-4848-a95b-73aa4fa7df90 from snapshot f6fe62de-bc6d-400a-9d19-a6ee153fbf4a {{(pid=88880) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Acquiring lock "cinder-quobyte-660791ff-f754-4848-a95b-73aa4fa7df90" by "_copy_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:19 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-077023cf-1681-45ad-8d28-38230a41dfb6 tempest-CreateVolumesFromSnapshotTest-550363960 None] Create snapshot completed successfully
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Lock "cinder-quobyte-660791ff-f754-4848-a95b-73aa4fa7df90" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] snapshot: f6fe62de-bc6d-400a-9d19-a6ee153fbf4a, volume: 660791ff-f754-4848-a95b-73aa4fa7df90,  {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb26e582-108c-4933-b2a8-57343c2fe883]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:19 devstack sudo[107736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a
Aug 04 09:36:19 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:20 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a" returned: 0 in 0.409s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f933215f-bd6b-4670-8c7c-057bb2e5314a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:36:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Aug 04 09:36:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Creating direct copy from snapshot {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Aug 04 09:36:20 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f612c1-8acc-4713-a025-eac504599f93]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:20 devstack sudo[107746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a
Aug 04 09:36:20 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:20 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a" returned: 0 in 0.500s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:20 devstack cinder-volume[88880]: DEBUG cinder.utils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Path /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90 not found in is_blk_device check {{(pid=88880) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 04 09:36:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:20 devstack sudo[107751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90
Aug 04 09:36:20 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:21 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:36:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Flow 'volume_create_manager' (7d52eacb-1b8b-4834-9253-ac8ba304318d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f2163c-772b-468d-a65e-7dbc5cd87638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f2163c-772b-468d-a65e-7dbc5cd87638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1494692333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22da405f-cb9b-4f63-a3dc-d2a037a90ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d7902bd5c45dfa9f9636a16ee0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:21Z,use_quota=True,user_id='aed6dc8a44fe4fd8ae770fc8634b654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7650489f-1529-4519-9d65-84f994c0d050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7650489f-1529-4519-9d65-84f994c0d050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad89634f-7989-4f30-83de-540791cf1439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad89634f-7989-4f30-83de-540791cf1439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22da405f-cb9b-4f63-a3dc-d2a037a90ea3', 'volume_name': 'volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26fa38b-4107-40d5-b524-7126a62ee29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26fa38b-4107-40d5-b524-7126a62ee29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:21 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85545941-83fa-4b06-89b9-530735d4579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:21 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume 22da405f-cb9b-4f63-a3dc-d2a037a90ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3', 'volume_size': 1}
Aug 04 09:36:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:22 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:36:22 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Flow 'volume_create_manager' (ec3941b2-ff6c-4ff9-85c3-40f7336d9664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:22 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2952f5-a4fd-425d-9048-6c2adf85a87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:22 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2952f5-a4fd-425d-9048-6c2adf85a87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2061383481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730ad7d7-34a6-4a85-aef4-074806114d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d7902bd5c45dfa9f9636a16ee0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:23Z,use_quota=True,user_id='aed6dc8a44fe4fd8ae770fc8634b654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c269bd68-f0b9-4556-a8e3-e9c14cf50427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c269bd68-f0b9-4556-a8e3-e9c14cf50427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85a2d69-1e19-42fb-9d91-cb23998e5f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85a2d69-1e19-42fb-9d91-cb23998e5f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '730ad7d7-34a6-4a85-aef4-074806114d4e', 'volume_name': 'volume-730ad7d7-34a6-4a85-aef4-074806114d4e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c457437-a109-4ad7-9136-ec452befde68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c457437-a109-4ad7-9136-ec452befde68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc35ce92-b9b0-4a8f-8067-40f9bf3b41e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:23 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume 730ad7d7-34a6-4a85-aef4-074806114d4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-730ad7d7-34a6-4a85-aef4-074806114d4e', 'volume_size': 1}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Flow 'volume_create_manager' (e917751e-144c-45aa-864c-f29ad3f61a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb3eec5-6625-4694-bf2f-8b22cefb6df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb3eec5-6625-4694-bf2f-8b22cefb6df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363384036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e210d892-7088-4e1f-8e1b-7a772b3b4b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d7902bd5c45dfa9f9636a16ee0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:23Z,use_quota=True,user_id='aed6dc8a44fe4fd8ae770fc8634b654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e991b4-49e8-4ece-809d-920fdd22aa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e991b4-49e8-4ece-809d-920fdd22aa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed170706-ba53-49e1-b47e-6c824c31f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed170706-ba53-49e1-b47e-6c824c31f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e210d892-7088-4e1f-8e1b-7a772b3b4b80', 'volume_name': 'volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74af79a8-6650-4c01-b9fa-491efddbdd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74af79a8-6650-4c01-b9fa-491efddbdd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd76747-38a3-49c3-8830-3bcfc8e1668c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:23 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume e210d892-7088-4e1f-8e1b-7a772b3b4b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80', 'volume_size': 1}
Aug 04 09:36:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:24 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:36:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Flow 'volume_create_manager' (75f772bf-3de6-4490-89a5-35e368992e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07968a7f-f1c1-4fd3-b2d3-2d260f5649d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07968a7f-f1c1-4fd3-b2d3-2d260f5649d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1248745965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba3fc24-4304-41c5-929b-1eb65440abcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d7902bd5c45dfa9f9636a16ee0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:24Z,use_quota=True,user_id='aed6dc8a44fe4fd8ae770fc8634b654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a59656-31c6-40e0-a7a6-952b5d027bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a59656-31c6-40e0-a7a6-952b5d027bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69524a72-c9a2-43cb-83a3-115a79952659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69524a72-c9a2-43cb-83a3-115a79952659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba3fc24-4304-41c5-929b-1eb65440abcc', 'volume_name': 'volume-1ba3fc24-4304-41c5-929b-1eb65440abcc', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd8b384-9312-4609-aea7-369bdebf452a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd8b384-9312-4609-aea7-369bdebf452a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9048734e-7c28-4676-94d0-c7761ab9ef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:24 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume 1ba3fc24-4304-41c5-929b-1eb65440abcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba3fc24-4304-41c5-929b-1eb65440abcc', 'volume_size': 1}
Aug 04 09:36:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:25 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:36:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Flow 'volume_create_manager' (72d1cb34-fced-48c8-b98d-e59462290f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f814c8a-5f8e-4ce0-9ab9-44292cc6704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f814c8a-5f8e-4ce0-9ab9-44292cc6704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-413830681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b972573d-cd2d-43c9-9c9e-de217a0deab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d7902bd5c45dfa9f9636a16ee0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:25Z,use_quota=True,user_id='aed6dc8a44fe4fd8ae770fc8634b654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56940e73-0559-4eea-8ec1-8c7c8627bfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56940e73-0559-4eea-8ec1-8c7c8627bfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4875bf3a-ce8a-4779-9eea-e49ff3ca7be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4875bf3a-ce8a-4779-9eea-e49ff3ca7be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b972573d-cd2d-43c9-9c9e-de217a0deab3', 'volume_name': 'volume-b972573d-cd2d-43c9-9c9e-de217a0deab3', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc2a290-ff79-4dd0-a799-996b537e16fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc2a290-ff79-4dd0-a799-996b537e16fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226980e4-d88b-43a4-b91f-055d93ecd6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:25 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume b972573d-cd2d-43c9-9c9e-de217a0deab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b972573d-cd2d-43c9-9c9e-de217a0deab3', 'volume_size': 1}
Aug 04 09:36:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:27 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90" returned: 0 in 6.585s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:27 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[422aea6e-7297-4544-b302-aa5ee50dc249]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:27 devstack sudo[107792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a
Aug 04 09:36:27 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:27 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a" returned: 0 in 0.666s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:27 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:36:27 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Converted 1024.00 MB image at 155.48 MB/s
Aug 04 09:36:27 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90 is being set with open permissions: ugo+rw
Aug 04 09:36:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:28 devstack sudo[107812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90
Aug 04 09:36:28 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:28 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90" returned: 0 in 0.340s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Lock "cinder-quobyte-660791ff-f754-4848-a95b-73aa4fa7df90" released by "_copy_volume_from_snapshot" :: held 8.639s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Lock "cinder-quobyte-f6fe62de-bc6d-400a-9d19-a6ee153fbf4a-660791ff-f754-4848-a95b-73aa4fa7df90" released by "_create_volume_from_snapshot" :: held 8.687s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.721s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.935s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1494692333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22da405f-cb9b-4f63-a3dc-d2a037a90ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d7902bd5c45dfa9f9636a16ee0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:21Z,use_quota=True,user_id='aed6dc8a44fe4fd8ae770fc8634b654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Creating volume 22da405f-cb9b-4f63-a3dc-d2a037a90ea3 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:36:28 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:28 devstack sudo[107828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3 1073741824
Aug 04 09:36:28 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5c3c65-61dd-4f45-840a-d4744ef5c4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660791ff-f754-4848-a95b-73aa4fa7df90', 'volume_size': 1, 'snapshot_id': 'f6fe62de-bc6d-400a-9d19-a6ee153fbf4a'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b639da-da34-4e41-91dc-8acef928f78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:28 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Volume volume-660791ff-f754-4848-a95b-73aa4fa7df90 (660791ff-f754-4848-a95b-73aa4fa7df90): created successfully
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b639da-da34-4e41-91dc-8acef928f78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Flow 'volume_create_manager' (bee011cc-a995-4ee0-9f70-37fa0274a261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:28 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-fe47212d-581e-48b2-8103-16e7efc8a15f tempest-TestStampPattern-11892702 None] Created volume successfully.
Aug 04 09:36:28 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3 1073741824" returned: 0 in 0.583s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:29 devstack sudo[107849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3
Aug 04 09:36:29 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:29 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3" returned: 0 in 0.243s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.078s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2061383481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730ad7d7-34a6-4a85-aef4-074806114d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d7902bd5c45dfa9f9636a16ee0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:23Z,use_quota=True,user_id='aed6dc8a44fe4fd8ae770fc8634b654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Creating volume 730ad7d7-34a6-4a85-aef4-074806114d4e {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:36:29 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-730ad7d7-34a6-4a85-aef4-074806114d4e 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85545941-83fa-4b06-89b9-530735d4579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:29 devstack sudo[107866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-730ad7d7-34a6-4a85-aef4-074806114d4e 1073741824
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31360ca-41b0-42a0-9624-325408e24af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:29 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:29 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3 (22da405f-cb9b-4f63-a3dc-d2a037a90ea3): created successfully
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31360ca-41b0-42a0-9624-325408e24af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Flow 'volume_create_manager' (7d52eacb-1b8b-4834-9253-ac8ba304318d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:29 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d45814b9-11f8-407f-88c9-40cf1731e43a tempest-CreateVolumesFromSnapshotTest-550363960 None] Created volume successfully.
Aug 04 09:36:29 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-730ad7d7-34a6-4a85-aef4-074806114d4e 1073741824" returned: 0 in 0.469s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-730ad7d7-34a6-4a85-aef4-074806114d4e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:29 devstack sudo[107872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-730ad7d7-34a6-4a85-aef4-074806114d4e
Aug 04 09:36:29 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:29 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-730ad7d7-34a6-4a85-aef4-074806114d4e" returned: 0 in 0.254s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.285s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363384036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e210d892-7088-4e1f-8e1b-7a772b3b4b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d7902bd5c45dfa9f9636a16ee0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:23Z,use_quota=True,user_id='aed6dc8a44fe4fd8ae770fc8634b654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Creating volume e210d892-7088-4e1f-8e1b-7a772b3b4b80 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:36:30 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc35ce92-b9b0-4a8f-8067-40f9bf3b41e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-730ad7d7-34a6-4a85-aef4-074806114d4e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:30 devstack sudo[107878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80 1073741824
Aug 04 09:36:30 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fbf7c3-951e-47ce-9de5-43f1f1847c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume volume-730ad7d7-34a6-4a85-aef4-074806114d4e (730ad7d7-34a6-4a85-aef4-074806114d4e): created successfully
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fbf7c3-951e-47ce-9de5-43f1f1847c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Flow 'volume_create_manager' (ec3941b2-ff6c-4ff9-85c3-40f7336d9664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:30 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-59814c37-699f-4ed4-99bd-238b23b9641c tempest-CreateVolumesFromSnapshotTest-550363960 None] Created volume successfully.
Aug 04 09:36:30 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80 1073741824" returned: 0 in 0.635s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:30 devstack sudo[107884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80
Aug 04 09:36:30 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:30 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80" returned: 0 in 0.235s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.192s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1248745965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba3fc24-4304-41c5-929b-1eb65440abcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d7902bd5c45dfa9f9636a16ee0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:24Z,use_quota=True,user_id='aed6dc8a44fe4fd8ae770fc8634b654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Creating volume 1ba3fc24-4304-41c5-929b-1eb65440abcc {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:36:30 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ba3fc24-4304-41c5-929b-1eb65440abcc 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd76747-38a3-49c3-8830-3bcfc8e1668c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:30 devstack sudo[107887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ba3fc24-4304-41c5-929b-1eb65440abcc 1073741824
Aug 04 09:36:30 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:30 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce95a5aa-3bea-4ad4-9385-13debb59b0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:30 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80 (e210d892-7088-4e1f-8e1b-7a772b3b4b80): created successfully
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce95a5aa-3bea-4ad4-9385-13debb59b0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Flow 'volume_create_manager' (e917751e-144c-45aa-864c-f29ad3f61a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:31 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-67ebd940-f67c-4a80-b2f4-27a9852c5898 tempest-CreateVolumesFromSnapshotTest-550363960 None] Created volume successfully.
Aug 04 09:36:31 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ba3fc24-4304-41c5-929b-1eb65440abcc 1073741824" returned: 0 in 0.488s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ba3fc24-4304-41c5-929b-1eb65440abcc {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:31 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ba3fc24-4304-41c5-929b-1eb65440abcc
Aug 04 09:36:31 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:31 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ba3fc24-4304-41c5-929b-1eb65440abcc" returned: 0 in 0.325s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.280s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-413830681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b972573d-cd2d-43c9-9c9e-de217a0deab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8d7902bd5c45dfa9f9636a16ee0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:25Z,use_quota=True,user_id='aed6dc8a44fe4fd8ae770fc8634b654a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Creating volume b972573d-cd2d-43c9-9c9e-de217a0deab3 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:36:31 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b972573d-cd2d-43c9-9c9e-de217a0deab3 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:31 devstack sudo[107896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b972573d-cd2d-43c9-9c9e-de217a0deab3 1073741824
Aug 04 09:36:31 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9048734e-7c28-4676-94d0-c7761ab9ef9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba3fc24-4304-41c5-929b-1eb65440abcc', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd3fb50-08c6-4819-bdf1-e11aa2c5b3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:31 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume volume-1ba3fc24-4304-41c5-929b-1eb65440abcc (1ba3fc24-4304-41c5-929b-1eb65440abcc): created successfully
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd3fb50-08c6-4819-bdf1-e11aa2c5b3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:31 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Flow 'volume_create_manager' (75f772bf-3de6-4490-89a5-35e368992e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:31 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ac201172-8bc6-462b-8bd2-a3ddbad7ad04 tempest-CreateVolumesFromSnapshotTest-550363960 None] Created volume successfully.
Aug 04 09:36:32 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b972573d-cd2d-43c9-9c9e-de217a0deab3 1073741824" returned: 0 in 0.533s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b972573d-cd2d-43c9-9c9e-de217a0deab3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:32 devstack sudo[107902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b972573d-cd2d-43c9-9c9e-de217a0deab3
Aug 04 09:36:32 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:32 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b972573d-cd2d-43c9-9c9e-de217a0deab3" returned: 0 in 0.280s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:36:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226980e4-d88b-43a4-b91f-055d93ecd6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b972573d-cd2d-43c9-9c9e-de217a0deab3', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f273afb1-cff2-4537-91a8-3723047cfe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:32 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Volume volume-b972573d-cd2d-43c9-9c9e-de217a0deab3 (b972573d-cd2d-43c9-9c9e-de217a0deab3): created successfully
Aug 04 09:36:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f273afb1-cff2-4537-91a8-3723047cfe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:32 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Flow 'volume_create_manager' (72d1cb34-fced-48c8-b98d-e59462290f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:32 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e9696bd6-76d6-4c16-9c13-02a055ef4f18 tempest-CreateVolumesFromSnapshotTest-550363960 None] Created volume successfully.
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-b972573d-cd2d-43c9-9c9e-de217a0deab3-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-b972573d-cd2d-43c9-9c9e-de217a0deab3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-quobyte-b972573d-cd2d-43c9-9c9e-de217a0deab3" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-b972573d-cd2d-43c9-9c9e-de217a0deab3" acquired by "delete_volume" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[43387085-2ea4-4412-be7f-073ca7cae76f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b972573d-cd2d-43c9-9c9e-de217a0deab3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:33 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b972573d-cd2d-43c9-9c9e-de217a0deab3
Aug 04 09:36:33 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:33 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b972573d-cd2d-43c9-9c9e-de217a0deab3" returned: 0 in 0.400s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b972573d-cd2d-43c9-9c9e-de217a0deab3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:33 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b972573d-cd2d-43c9-9c9e-de217a0deab3
Aug 04 09:36:33 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:33 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-b972573d-cd2d-43c9-9c9e-de217a0deab3" returned: 0 in 0.249s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-b972573d-cd2d-43c9-9c9e-de217a0deab3" released by "delete_volume" :: held 0.700s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Created reservations ['78bbb715-8044-4bd8-b7c8-9db269d38a53', '4fd41044-71c3-45e9-9d15-32501c9891ee', '898500fc-4b46-4bd8-aa98-8b3964a59df1', '4b36995c-8ca6-414f-8362-c78e4297b228'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:33 devstack sudo[107913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:36:33 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-1ba3fc24-4304-41c5-929b-1eb65440abcc-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:34 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.320s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:34 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:36:34 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Deleted volume successfully.
Aug 04 09:36:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-1ba3fc24-4304-41c5-929b-1eb65440abcc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ed25aac3-f1e9-4c2f-9b64-4b8bd9177fdd tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-b972573d-cd2d-43c9-9c9e-de217a0deab3-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-quobyte-1ba3fc24-4304-41c5-929b-1eb65440abcc" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-1ba3fc24-4304-41c5-929b-1eb65440abcc" acquired by "delete_volume" :: waited 0.013s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:34 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1097b07-7cc5-4cfd-8e2b-0022bccc69ff]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ba3fc24-4304-41c5-929b-1eb65440abcc {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:34 devstack sudo[107917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ba3fc24-4304-41c5-929b-1eb65440abcc
Aug 04 09:36:34 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:34 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ba3fc24-4304-41c5-929b-1eb65440abcc" returned: 0 in 0.417s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ba3fc24-4304-41c5-929b-1eb65440abcc {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:34 devstack sudo[107924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ba3fc24-4304-41c5-929b-1eb65440abcc
Aug 04 09:36:34 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:35 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1ba3fc24-4304-41c5-929b-1eb65440abcc" returned: 0 in 0.280s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-1ba3fc24-4304-41c5-929b-1eb65440abcc" released by "delete_volume" :: held 0.737s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Created reservations ['fedbf0a7-cbe6-46c6-9606-8265a7c7e5a0', '16a2ae5f-151f-4d07-89e1-7e2b876316a4', '6cc2d4ba-1b54-4c27-8f1c-65e4b5d1303f', '1a347c1d-97e3-4a45-93b1-0bc360dabbea'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:35 devstack sudo[107927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:36:35 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-e210d892-7088-4e1f-8e1b-7a772b3b4b80-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-e210d892-7088-4e1f-8e1b-7a772b3b4b80-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-quobyte-e210d892-7088-4e1f-8e1b-7a772b3b4b80" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:35 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.312s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-e210d892-7088-4e1f-8e1b-7a772b3b4b80" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:35 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Deleted volume successfully.
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e28e2ae-d050-4f8e-9ae6-faf8ca097380]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-727e46b6-65d2-4056-93a5-a3c2ab5160c9 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-1ba3fc24-4304-41c5-929b-1eb65440abcc-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:35 devstack sudo[107930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80
Aug 04 09:36:35 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:35 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80" returned: 0 in 0.346s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:35 devstack sudo[107935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80
Aug 04 09:36:35 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:36 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e210d892-7088-4e1f-8e1b-7a772b3b4b80" returned: 0 in 0.242s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-e210d892-7088-4e1f-8e1b-7a772b3b4b80" released by "delete_volume" :: held 0.642s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Created reservations ['dbd09c22-27a4-4ddb-823b-51ef941b786f', '5f9ec361-a5db-4274-ab46-b85434b0f8e3', '7304520e-07eb-4795-9f04-893bcc29b7c5', 'be758d0e-b06e-4ff3-b3d3-f3f01fae8dcf'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:36 devstack sudo[107938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:36:36 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:36 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.282s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:36:36 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Deleted volume successfully.
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-730ad7d7-34a6-4a85-aef4-074806114d4e-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-982da6be-641a-4ee3-852c-bf7715d7895c tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-e210d892-7088-4e1f-8e1b-7a772b3b4b80-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-730ad7d7-34a6-4a85-aef4-074806114d4e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-quobyte-730ad7d7-34a6-4a85-aef4-074806114d4e" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-730ad7d7-34a6-4a85-aef4-074806114d4e" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6361b6c7-6dd1-44d9-ba6f-134031a62a68]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-730ad7d7-34a6-4a85-aef4-074806114d4e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:36 devstack sudo[107941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-730ad7d7-34a6-4a85-aef4-074806114d4e
Aug 04 09:36:36 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:37 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-730ad7d7-34a6-4a85-aef4-074806114d4e" returned: 0 in 0.356s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-730ad7d7-34a6-4a85-aef4-074806114d4e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:37 devstack sudo[107947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-730ad7d7-34a6-4a85-aef4-074806114d4e
Aug 04 09:36:37 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:37 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-730ad7d7-34a6-4a85-aef4-074806114d4e" returned: 0 in 0.239s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-730ad7d7-34a6-4a85-aef4-074806114d4e" released by "delete_volume" :: held 0.634s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Created reservations ['d8a2a519-a6b4-4b93-a03f-4299e7f0f9f1', '598509fb-85fb-421a-a7ba-a5306bfe0acb', '327fcef0-e8a1-4dd4-a8ad-4c6eac33f12d', '835e14a0-d9c0-4ede-b556-3ff031e761d1'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:37 devstack sudo[107950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:36:37 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:37 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.268s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:36:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Deleted volume successfully.
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a931933a-6025-4834-b717-9e38c7fbd085 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-730ad7d7-34a6-4a85-aef4-074806114d4e-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-22da405f-cb9b-4f63-a3dc-d2a037a90ea3-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-22da405f-cb9b-4f63-a3dc-d2a037a90ea3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-quobyte-22da405f-cb9b-4f63-a3dc-d2a037a90ea3" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-22da405f-cb9b-4f63-a3dc-d2a037a90ea3" acquired by "delete_volume" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f4f5c6-dc22-47dd-862e-ce57b44975a9]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:38 devstack sudo[107953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3
Aug 04 09:36:38 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:38 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3" returned: 0 in 0.375s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:38 devstack sudo[107958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3
Aug 04 09:36:38 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:38 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-22da405f-cb9b-4f63-a3dc-d2a037a90ea3" returned: 0 in 0.247s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-22da405f-cb9b-4f63-a3dc-d2a037a90ea3" released by "delete_volume" :: held 0.660s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Created reservations ['30236095-8726-4aa7-ba22-56e7fe6a1d69', '87eb6c3c-1b2c-4693-a1a3-94ce91b3c65b', 'b12b867e-da76-491e-8555-6cbfec4bc8de', '78399313-b0e9-479f-81a0-054781e05cf9'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:38 devstack sudo[107961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:36:38 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:38 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.248s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:38 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:36:38 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Deleted volume successfully.
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4fc901b0-aaa8-46aa-9479-255126ebe1f4 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-22da405f-cb9b-4f63-a3dc-d2a037a90ea3-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-77ec9ccc-ff0a-49cd-9a5a-deddc136dbce-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-77ec9ccc-ff0a-49cd-9a5a-deddc136dbce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-quobyte-0ecae993-716d-4043-940a-94a51a03da21" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-0ecae993-716d-4043-940a-94a51a03da21" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-quobyte-77ec9ccc-ff0a-49cd-9a5a-deddc136dbce" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-77ec9ccc-ff0a-49cd-9a5a-deddc136dbce" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Deleting offline snapshot 77ec9ccc-ff0a-49cd-9a5a-deddc136dbce of volume 0ecae993-716d-4043-940a-94a51a03da21 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] snapshot_file for this snap is: volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73e4a92-e11d-49a0-8930-9284c77223ac]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:39 devstack sudo[107964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce
Aug 04 09:36:39 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:39 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce" returned: 0 in 0.340s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ecae993-716d-4043-940a-94a51a03da21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b127489-7972-4984-9984-d1b598cb6093]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:39 devstack sudo[107969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21
Aug 04 09:36:39 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:39 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21" returned: 0 in 0.371s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:39 devstack sudo[107974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce
Aug 04 09:36:39 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:40 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce" returned: 0 in 0.361s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:40 devstack sudo[107980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce
Aug 04 09:36:40 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:40 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21.77ec9ccc-ff0a-49cd-9a5a-deddc136dbce" returned: 0 in 0.243s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-77ec9ccc-ff0a-49cd-9a5a-deddc136dbce" released by "_delete_snapshot" :: held 1.417s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-0ecae993-716d-4043-940a-94a51a03da21" released by "delete_snapshot" :: held 1.445s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:40 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Created reservations ['d4633b2b-5f15-4b19-88ed-fa963a19e1eb', '367d7917-f03e-49c4-b24c-fdd4d05aafd3', '30e857eb-682c-4c12-80e5-e866123b83c0', 'a8ccad78-b6b0-4568-bf6d-6e7507133afd'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:36:40 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Delete snapshot completed successfully.
Aug 04 09:36:40 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2bc66aba-1534-45ea-b70b-80aade380720 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-77ec9ccc-ff0a-49cd-9a5a-deddc136dbce-delete_snapshot" released by "delete_snapshot" :: held 1.588s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-0ecae993-716d-4043-940a-94a51a03da21-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-0ecae993-716d-4043-940a-94a51a03da21-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "cinder-quobyte-0ecae993-716d-4043-940a-94a51a03da21" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-0ecae993-716d-4043-940a-94a51a03da21" acquired by "delete_volume" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:41 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be26a17-e27c-466a-902d-f61eb540e16b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:41 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21
Aug 04 09:36:41 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:41 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21" returned: 0 in 0.364s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:41 devstack sudo[107988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21
Aug 04 09:36:41 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:41 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0ecae993-716d-4043-940a-94a51a03da21" returned: 0 in 0.243s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-quobyte-0ecae993-716d-4043-940a-94a51a03da21" released by "delete_volume" :: held 0.667s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:42 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Created reservations ['2c37e8d5-bca0-4cee-bc00-0fbfdfa872de', '1a7676e5-1ee2-40ef-bc1f-f5cebe4b69ca', 'd7609aa3-24df-4043-9315-553464403e54', '28e6acf4-e024-4939-a4f4-ca92bef6766a'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:36:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:42 devstack sudo[107997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:36:42 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:42 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.262s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:42 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:36:42 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Deleted volume successfully.
Aug 04 09:36:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-14a54151-03ec-4cb3-9a5c-97430dca4306 tempest-CreateVolumesFromSnapshotTest-550363960 None] Lock "cinder-0ecae993-716d-4043-940a-94a51a03da21-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Flow 'volume_create_manager' (892da212-6dcd-438c-b020-9c4bafdc4a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20efcac6-dc6f-4ea5-9150-6c36ca1a59fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20efcac6-dc6f-4ea5-9150-6c36ca1a59fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1917244444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2857a011-f7d8-47b2-b294-a367204039d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a02416d1e544d998c7105c1e34dc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:46Z,use_quota=True,user_id='3791126f2ecf4383b1a7b50bef74e6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4989d6-a8b2-4684-a368-212f4c6d943e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4989d6-a8b2-4684-a368-212f4c6d943e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8b62da-1def-41ad-9848-77f760f30fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8b62da-1def-41ad-9848-77f760f30fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2857a011-f7d8-47b2-b294-a367204039d7', 'volume_name': 'volume-2857a011-f7d8-47b2-b294-a367204039d7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0cab93-4a87-4d0e-bfeb-5701922e2869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0cab93-4a87-4d0e-bfeb-5701922e2869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36377e5-acc3-4dc4-977b-1f1edef5a0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:45 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Volume 2857a011-f7d8-47b2-b294-a367204039d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2857a011-f7d8-47b2-b294-a367204039d7', 'volume_size': 1}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1917244444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2857a011-f7d8-47b2-b294-a367204039d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a02416d1e544d998c7105c1e34dc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:46Z,use_quota=True,user_id='3791126f2ecf4383b1a7b50bef74e6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Creating volume 2857a011-f7d8-47b2-b294-a367204039d7 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:36:45 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:36:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2857a011-f7d8-47b2-b294-a367204039d7 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:45 devstack sudo[108000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2857a011-f7d8-47b2-b294-a367204039d7 1073741824
Aug 04 09:36:45 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:46 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2857a011-f7d8-47b2-b294-a367204039d7 1073741824" returned: 0 in 0.469s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2857a011-f7d8-47b2-b294-a367204039d7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:46 devstack sudo[108040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2857a011-f7d8-47b2-b294-a367204039d7
Aug 04 09:36:46 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:46 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2857a011-f7d8-47b2-b294-a367204039d7" returned: 0 in 0.274s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:36:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36377e5-acc3-4dc4-977b-1f1edef5a0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2857a011-f7d8-47b2-b294-a367204039d7', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56427c2b-d28a-46fd-b3f0-2e6baf148a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:46 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Volume volume-2857a011-f7d8-47b2-b294-a367204039d7 (2857a011-f7d8-47b2-b294-a367204039d7): created successfully
Aug 04 09:36:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56427c2b-d28a-46fd-b3f0-2e6baf148a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:46 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Flow 'volume_create_manager' (892da212-6dcd-438c-b020-9c4bafdc4a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:46 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-8cb4f18c-ea8b-42a7-a68a-3675b96364e6 tempest-ProjectReaderTests-439074978 None] Created volume successfully.
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Acquiring lock "cinder-2857a011-f7d8-47b2-b294-a367204039d7-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Lock "cinder-2857a011-f7d8-47b2-b294-a367204039d7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Acquiring lock "cinder-quobyte-2857a011-f7d8-47b2-b294-a367204039d7" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Lock "cinder-quobyte-2857a011-f7d8-47b2-b294-a367204039d7" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9689cd8a-3391-40c7-90b4-8428904fd543]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2857a011-f7d8-47b2-b294-a367204039d7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:47 devstack sudo[108045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2857a011-f7d8-47b2-b294-a367204039d7
Aug 04 09:36:47 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:47 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2857a011-f7d8-47b2-b294-a367204039d7" returned: 0 in 0.364s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2857a011-f7d8-47b2-b294-a367204039d7 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:47 devstack sudo[108051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2857a011-f7d8-47b2-b294-a367204039d7
Aug 04 09:36:47 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:47 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2857a011-f7d8-47b2-b294-a367204039d7" returned: 0 in 0.269s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Lock "cinder-quobyte-2857a011-f7d8-47b2-b294-a367204039d7" released by "delete_volume" :: held 0.673s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Created reservations ['c5868042-1dcc-4c9f-a480-c3ff482c0c0a', 'e3c48fa9-d327-4760-9c5b-afb0f9f7417f', '01e3eef2-8f39-4fa1-94d7-339d708db1b8', '635114ff-984e-4852-b7ae-6fd0a3632cf0'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:47 devstack sudo[108054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:36:47 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:48 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.254s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:36:48 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Deleted volume successfully.
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dd7db2bf-8a93-4c0c-8fab-8336ec3237aa tempest-ProjectReaderTests-439074978 None] Lock "cinder-2857a011-f7d8-47b2-b294-a367204039d7-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Flow 'volume_create_manager' (330765c6-689e-4912-a23a-3ac9fa7392dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d3d142-33bd-48ac-83c3-7ed390ea31b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d3d142-33bd-48ac-83c3-7ed390ea31b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1413255418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7a223d-915b-4ce6-89ac-6d9a29117d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a02416d1e544d998c7105c1e34dc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:49Z,use_quota=True,user_id='3791126f2ecf4383b1a7b50bef74e6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c4a7ce-f04b-4ef2-a6d4-cc323f765968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c4a7ce-f04b-4ef2-a6d4-cc323f765968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392f67d9-fcfe-484c-902d-a42e244c41c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392f67d9-fcfe-484c-902d-a42e244c41c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c7a223d-915b-4ce6-89ac-6d9a29117d7d', 'volume_name': 'volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf654c69-056d-4a1d-b2c6-cb7422b008af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf654c69-056d-4a1d-b2c6-cb7422b008af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb102ad-50d4-4e29-9e2d-55a761975767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:48 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Volume 1c7a223d-915b-4ce6-89ac-6d9a29117d7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d', 'volume_size': 1}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1413255418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7a223d-915b-4ce6-89ac-6d9a29117d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a02416d1e544d998c7105c1e34dc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:36:49Z,use_quota=True,user_id='3791126f2ecf4383b1a7b50bef74e6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Creating volume 1c7a223d-915b-4ce6-89ac-6d9a29117d7d {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:36:48 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:36:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:48 devstack sudo[108057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d 1073741824
Aug 04 09:36:48 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:49 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d 1073741824" returned: 0 in 0.415s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:49 devstack sudo[108062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d
Aug 04 09:36:49 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:49 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d" returned: 0 in 0.239s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb102ad-50d4-4e29-9e2d-55a761975767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2017c6d2-daf7-4993-8195-c019e80e3b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:36:49 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Volume volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d (1c7a223d-915b-4ce6-89ac-6d9a29117d7d): created successfully
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2017c6d2-daf7-4993-8195-c019e80e3b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Flow 'volume_create_manager' (330765c6-689e-4912-a23a-3ac9fa7392dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:36:49 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d1dedb29-9565-4db3-bd61-f87ce11129f1 tempest-ProjectReaderTests-439074978 None] Created volume successfully.
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Acquiring lock "cinder-1c7a223d-915b-4ce6-89ac-6d9a29117d7d-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Lock "cinder-1c7a223d-915b-4ce6-89ac-6d9a29117d7d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Acquiring lock "cinder-quobyte-1c7a223d-915b-4ce6-89ac-6d9a29117d7d" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Lock "cinder-quobyte-1c7a223d-915b-4ce6-89ac-6d9a29117d7d" acquired by "delete_volume" :: waited 0.014s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[37767d0c-531d-4c18-bc84-5e35a034393b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:49 devstack sudo[108065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d
Aug 04 09:36:49 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:50 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d" returned: 0 in 0.354s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:50 devstack sudo[108071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d
Aug 04 09:36:50 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:50 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1c7a223d-915b-4ce6-89ac-6d9a29117d7d" returned: 0 in 0.251s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Lock "cinder-quobyte-1c7a223d-915b-4ce6-89ac-6d9a29117d7d" released by "delete_volume" :: held 0.643s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Created reservations ['ca44b061-f554-4c8d-b2b4-542bb48ddc9f', '531e00d8-304c-451a-b12b-1651c252e9f3', 'de42e0ed-86c9-4431-8757-8a48f0a81754', '46613d20-81c5-4fe0-a9e7-7ba00d672879'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:50 devstack sudo[108074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:36:50 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:50 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.247s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:36:50 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Deleted volume successfully.
Aug 04 09:36:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bf09f0-6ed9-42b7-9567-8d9b8da816ac tempest-ProjectReaderTests-439074978 None] Lock "cinder-1c7a223d-915b-4ce6-89ac-6d9a29117d7d-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:36:55 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=78,cinder:UPDATE=116,cinder:INSERT=24,cinder:DELETE=10 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:36:55 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=90,cinder:INSERT=26,cinder:UPDATE=101,cinder:DELETE=10 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:36:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-59836545-e9f8-48d4-995d-c485693a66fb req-3cb453f0-d3d7-4228-81ea-5cd96d4dc553 tempest-TestStampPattern-11892702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:36:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-59836545-e9f8-48d4-995d-c485693a66fb req-3cb453f0-d3d7-4228-81ea-5cd96d4dc553 tempest-TestStampPattern-11892702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:36:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d45a215-6cc3-413f-83db-90136d2d4eaa]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:36:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-59836545-e9f8-48d4-995d-c485693a66fb req-3cb453f0-d3d7-4228-81ea-5cd96d4dc553 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:36:55 devstack sudo[108100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90
Aug 04 09:36:55 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:36:55 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root
Aug 04 09:36:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [req-59836545-e9f8-48d4-995d-c485693a66fb req-3cb453f0-d3d7-4228-81ea-5cd96d4dc553 tempest-TestStampPattern-11892702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90" returned: 0 in 0.393s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:36:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [req-59836545-e9f8-48d4-995d-c485693a66fb req-3cb453f0-d3d7-4228-81ea-5cd96d4dc553 tempest-TestStampPattern-11892702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.421s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:36:55 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-59836545-e9f8-48d4-995d-c485693a66fb req-3cb453f0-d3d7-4228-81ea-5cd96d4dc553 tempest-TestStampPattern-11892702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35', 'name': 'volume-660791ff-f754-4848-a95b-73aa4fa7df90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6de97e07-11b6-4398-aa65-10bf60794a71', 'enforce_multipath': True} {{(pid=88880) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 04 09:36:55 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-59836545-e9f8-48d4-995d-c485693a66fb req-3cb453f0-d3d7-4228-81ea-5cd96d4dc553 tempest-TestStampPattern-11892702 None] attachment_update completed successfully.
Aug 04 09:36:58 devstack cinder-volume[88880]: INFO cinder.volume.manager [req-28db6606-3466-4a5d-a5a9-63202e82f9c2 req-24dec878-647d-41a5-978a-f9fb0e57c00d tempest-TestStampPattern-11892702 None] Terminate volume connection completed successfully.
Aug 04 09:36:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [req-28db6606-3466-4a5d-a5a9-63202e82f9c2 req-24dec878-647d-41a5-978a-f9fb0e57c00d tempest-TestStampPattern-11892702 None] Deleting attachment 6de97e07-11b6-4398-aa65-10bf60794a71. {{(pid=88880) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 04 09:37:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Acquiring lock "cinder-660791ff-f754-4848-a95b-73aa4fa7df90-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Lock "cinder-660791ff-f754-4848-a95b-73aa4fa7df90-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Acquiring lock "cinder-quobyte-660791ff-f754-4848-a95b-73aa4fa7df90" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:02 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Lock "cinder-quobyte-660791ff-f754-4848-a95b-73aa4fa7df90" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:02 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04d9dd0-d42f-4e59-a75e-702de156ce76]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:03 devstack sudo[108578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90
Aug 04 09:37:03 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:03 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90" returned: 0 in 0.381s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:03 devstack sudo[108584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90
Aug 04 09:37:03 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:03 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-660791ff-f754-4848-a95b-73aa4fa7df90" returned: 0 in 0.251s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Lock "cinder-quobyte-660791ff-f754-4848-a95b-73aa4fa7df90" released by "delete_volume" :: held 0.692s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Created reservations ['e52b2ac4-a7d8-4533-aea4-96da4026c498', 'e23d863c-aecb-4c14-8bb8-90ef3251cbfa', '22224336-4ea2-4c2b-b533-92dbccd9b763', '72acb86e-6586-48b7-8d1e-60569c96fc97'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:03 devstack sudo[108587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:03 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:03 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.236s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:03 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Deleted volume successfully.
Aug 04 09:37:03 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c46e525f-4319-421e-b71f-48d7f753bbed tempest-TestStampPattern-11892702 None] Lock "cinder-660791ff-f754-4848-a95b-73aa4fa7df90-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Acquiring lock "cinder-f6fe62de-bc6d-400a-9d19-a6ee153fbf4a-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Lock "cinder-f6fe62de-bc6d-400a-9d19-a6ee153fbf4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Acquiring lock "cinder-quobyte-f933215f-bd6b-4670-8c7c-057bb2e5314a" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Lock "cinder-quobyte-f933215f-bd6b-4670-8c7c-057bb2e5314a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Acquiring lock "cinder-quobyte-f6fe62de-bc6d-400a-9d19-a6ee153fbf4a" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Lock "cinder-quobyte-f6fe62de-bc6d-400a-9d19-a6ee153fbf4a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Deleting offline snapshot f6fe62de-bc6d-400a-9d19-a6ee153fbf4a of volume f933215f-bd6b-4670-8c7c-057bb2e5314a {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] snapshot_file for this snap is: volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff31a0e7-750f-4dfd-aa90-de941e804b6b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:04 devstack sudo[108590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a
Aug 04 09:37:04 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:04 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a" returned: 0 in 0.377s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f933215f-bd6b-4670-8c7c-057bb2e5314a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba475ee-8a49-4212-824e-59c56a745fdf]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:04 devstack sudo[108595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a
Aug 04 09:37:04 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:05 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a" returned: 0 in 0.340s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:05 devstack sudo[108600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a
Aug 04 09:37:05 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:05 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a" returned: 0 in 0.321s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:05 devstack sudo[108605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a
Aug 04 09:37:05 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:05 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a.f6fe62de-bc6d-400a-9d19-a6ee153fbf4a" returned: 0 in 0.245s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Lock "cinder-quobyte-f6fe62de-bc6d-400a-9d19-a6ee153fbf4a" released by "_delete_snapshot" :: held 1.377s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Lock "cinder-quobyte-f933215f-bd6b-4670-8c7c-057bb2e5314a" released by "delete_snapshot" :: held 1.401s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:05 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Created reservations ['88531d70-7038-497d-91eb-23c0e60a64cb', '7033fcc9-c5dd-4625-975f-c5191db202d9', '79d86fe1-9482-4b9a-aa1a-049baad6af8e', 'cf5f3226-f972-42e7-8a55-72eb528ff453'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:05 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Delete snapshot completed successfully.
Aug 04 09:37:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-3d390177-0ea0-4067-acee-752807b05f96 tempest-TestStampPattern-11892702 None] Lock "cinder-f6fe62de-bc6d-400a-9d19-a6ee153fbf4a-delete_snapshot" released by "delete_snapshot" :: held 1.533s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:37:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:08 devstack sudo[108635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:08 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:08 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.292s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:37:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:37:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:37:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Acquiring lock "cinder-f933215f-bd6b-4670-8c7c-057bb2e5314a-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Lock "cinder-f933215f-bd6b-4670-8c7c-057bb2e5314a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Acquiring lock "cinder-quobyte-f933215f-bd6b-4670-8c7c-057bb2e5314a" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Lock "cinder-quobyte-f933215f-bd6b-4670-8c7c-057bb2e5314a" acquired by "delete_volume" :: waited 0.014s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:09 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ef2ef1-c88c-454e-8001-135af2c66f7a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:10 devstack sudo[108642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a
Aug 04 09:37:10 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:10 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a" returned: 0 in 0.344s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:10 devstack sudo[108647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a
Aug 04 09:37:10 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:10 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f933215f-bd6b-4670-8c7c-057bb2e5314a" returned: 0 in 0.237s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Lock "cinder-quobyte-f933215f-bd6b-4670-8c7c-057bb2e5314a" released by "delete_volume" :: held 0.635s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Created reservations ['1d99fbca-fd90-4b8b-ad93-4edc672c6755', '6aa6a7ad-83f4-40b0-9a6f-b101ef6908bd', '4908aab8-1846-4d55-9b5b-ab0562dc83f5', '6e1f4420-6f07-425b-bb50-ee3de63d08fb'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:10 devstack sudo[108650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:10 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:10 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.225s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:10 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Deleted volume successfully.
Aug 04 09:37:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4e0d78ef-5531-4af7-a02e-13c7581ab0bd tempest-TestStampPattern-11892702 None] Lock "cinder-f933215f-bd6b-4670-8c7c-057bb2e5314a-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:20 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=19,cinder:UPDATE=27,cinder:INSERT=7 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:37:20 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=23,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Flow 'volume_create_manager' (e582961b-d770-4a61-b627-c41b232c2056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21b876c-04ad-47bf-9de9-e44c98bde98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21b876c-04ad-47bf-9de9-e44c98bde98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1899046450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0454851f-79b0-492a-9169-042e5cc6a20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff12b7bf45045d9b63d5b52e205871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:34Z,use_quota=True,user_id='e99b062340964d39be27e2fdfa4b4b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f771f203-18a9-44fa-8d63-5c808fe89931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f771f203-18a9-44fa-8d63-5c808fe89931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbe9c66-a654-47d0-aa2c-5e8ad2833e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbe9c66-a654-47d0-aa2c-5e8ad2833e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0454851f-79b0-492a-9169-042e5cc6a20e', 'volume_name': 'volume-0454851f-79b0-492a-9169-042e5cc6a20e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015c12c1-a524-401e-8ad6-df2a599c9cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015c12c1-a524-401e-8ad6-df2a599c9cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c359ee-4627-4d83-b016-fcc5dd90362d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:34 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Volume 0454851f-79b0-492a-9169-042e5cc6a20e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0454851f-79b0-492a-9169-042e5cc6a20e', 'volume_size': 1}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1899046450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0454851f-79b0-492a-9169-042e5cc6a20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff12b7bf45045d9b63d5b52e205871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:34Z,use_quota=True,user_id='e99b062340964d39be27e2fdfa4b4b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Creating volume 0454851f-79b0-492a-9169-042e5cc6a20e {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:34 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0454851f-79b0-492a-9169-042e5cc6a20e 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:34 devstack sudo[108698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0454851f-79b0-492a-9169-042e5cc6a20e 1073741824
Aug 04 09:37:34 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Flow 'volume_create_manager' (dd719a60-c5e3-4c1e-88dd-0d585b7437a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86483bc-3290-40e0-9428-f6d2766ef776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86483bc-3290-40e0-9428-f6d2766ef776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-204863445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6be499-d61e-4d8f-a6eb-c8770c7f78d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff12b7bf45045d9b63d5b52e205871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:35Z,use_quota=True,user_id='e99b062340964d39be27e2fdfa4b4b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8411941c-0c8d-4546-b4b8-c32f5340a6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8411941c-0c8d-4546-b4b8-c32f5340a6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfc677d-e827-4cf2-ad54-70852604f282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfc677d-e827-4cf2-ad54-70852604f282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6be499-d61e-4d8f-a6eb-c8770c7f78d8', 'volume_name': 'volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5885377d-f439-42d6-a893-12ef14b2a267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5885377d-f439-42d6-a893-12ef14b2a267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6940ebf6-9e09-48c3-b588-da6d8392bdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Volume fe6be499-d61e-4d8f-a6eb-c8770c7f78d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8', 'volume_size': 1}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:35 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0454851f-79b0-492a-9169-042e5cc6a20e 1073741824" returned: 0 in 0.753s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Flow 'volume_create_manager' (2806b38f-ca00-400b-ab2d-dc6d3bdfc906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d914b9-e8ef-463a-b469-485c823886e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d914b9-e8ef-463a-b469-485c823886e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-495356417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e26577-b59e-4972-b9be-3bc84286187f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3747d58e4b44f0ab761bca4e5964be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:35Z,use_quota=True,user_id='d8196d42ab7a425e8967c24e73fa31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ea79bb-67c9-4937-9513-07ff4a040319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ea79bb-67c9-4937-9513-07ff4a040319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5fc20bd-c938-43b6-95eb-2a8d61242f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5fc20bd-c938-43b6-95eb-2a8d61242f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e26577-b59e-4972-b9be-3bc84286187f', 'volume_name': 'volume-e9e26577-b59e-4972-b9be-3bc84286187f', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b330599-044d-4c43-bcd6-dc6874128356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b330599-044d-4c43-bcd6-dc6874128356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bcfb135-0503-4813-8873-7176d8f94a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume e9e26577-b59e-4972-b9be-3bc84286187f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e26577-b59e-4972-b9be-3bc84286187f', 'volume_size': 1}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0454851f-79b0-492a-9169-042e5cc6a20e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:35 devstack sudo[108704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0454851f-79b0-492a-9169-042e5cc6a20e
Aug 04 09:37:35 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Flow 'volume_create_manager' (69097685-718a-40b8-9af1-b3b2ed606521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694a2f6f-8be4-49ca-bc5c-0bef417c22da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694a2f6f-8be4-49ca-bc5c-0bef417c22da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-52622611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc973c2-51f9-4f40-bcc9-2722ce5fc29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff12b7bf45045d9b63d5b52e205871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:35Z,use_quota=True,user_id='e99b062340964d39be27e2fdfa4b4b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca68bec-3f81-466d-9ed1-89904af1c0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca68bec-3f81-466d-9ed1-89904af1c0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2124d858-f1b3-4d6c-a45d-51ab0be6ecbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2124d858-f1b3-4d6c-a45d-51ab0be6ecbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc973c2-51f9-4f40-bcc9-2722ce5fc29b', 'volume_name': 'volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7df7391-02ea-40da-afe5-0a3c503ec1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7df7391-02ea-40da-afe5-0a3c503ec1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad48a3ea-8dfc-49de-b127-ac39a52e219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Volume bcc973c2-51f9-4f40-bcc9-2722ce5fc29b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b', 'volume_size': 1}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:35 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0454851f-79b0-492a-9169-042e5cc6a20e" returned: 0 in 0.358s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.537s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-204863445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6be499-d61e-4d8f-a6eb-c8770c7f78d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff12b7bf45045d9b63d5b52e205871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:35Z,use_quota=True,user_id='e99b062340964d39be27e2fdfa4b4b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Creating volume fe6be499-d61e-4d8f-a6eb-c8770c7f78d8 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:35 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:35 devstack sudo[108707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8 1073741824
Aug 04 09:37:35 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c359ee-4627-4d83-b016-fcc5dd90362d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0454851f-79b0-492a-9169-042e5cc6a20e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12de8f19-d1e5-45c6-a024-d0c2b2c947fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:35 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Volume volume-0454851f-79b0-492a-9169-042e5cc6a20e (0454851f-79b0-492a-9169-042e5cc6a20e): created successfully
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12de8f19-d1e5-45c6-a024-d0c2b2c947fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Flow 'volume_create_manager' (e582961b-d770-4a61-b627-c41b232c2056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:36 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9a8292e2-8e91-4c7a-be3d-26839ae75903 tempest-CreateVolumesFromImageTest-483980240 None] Created volume successfully.
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Flow 'volume_create_manager' (4c7e505b-e4be-4a59-8597-5cae97fb9d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2a9d23-f8e2-48aa-9572-da4d3f7e2d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2a9d23-f8e2-48aa-9572-da4d3f7e2d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452914073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c511fc0a-b3ef-4261-a118-9c295caac09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff12b7bf45045d9b63d5b52e205871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:36Z,use_quota=True,user_id='e99b062340964d39be27e2fdfa4b4b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13960418-bd09-4448-8c60-72ed86dab9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13960418-bd09-4448-8c60-72ed86dab9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a14c5c-831e-4ad6-bb5b-d6c227af55b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a14c5c-831e-4ad6-bb5b-d6c227af55b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c511fc0a-b3ef-4261-a118-9c295caac09d', 'volume_name': 'volume-c511fc0a-b3ef-4261-a118-9c295caac09d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd53644-ed5a-4200-9a4c-3d1924fa2d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd53644-ed5a-4200-9a4c-3d1924fa2d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6584839a-db9b-4101-b2db-005163b64111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:36 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Volume c511fc0a-b3ef-4261-a118-9c295caac09d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c511fc0a-b3ef-4261-a118-9c295caac09d', 'volume_size': 1}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:36 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Flow 'volume_create_manager' (a7aa789a-8730-4cda-adeb-d4798b367fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d075a7d-8005-41ed-a727-983601177960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8 1073741824" returned: 0 in 0.693s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d075a7d-8005-41ed-a727-983601177960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-767665761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71fac08a-69b3-432e-ad11-aa5c845a1306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff12b7bf45045d9b63d5b52e205871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:36Z,use_quota=True,user_id='e99b062340964d39be27e2fdfa4b4b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98523607-da64-4952-8c2a-f2ec1bae5079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98523607-da64-4952-8c2a-f2ec1bae5079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d230fa-91b9-48a4-a480-15606a5ca4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d230fa-91b9-48a4-a480-15606a5ca4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71fac08a-69b3-432e-ad11-aa5c845a1306', 'volume_name': 'volume-71fac08a-69b3-432e-ad11-aa5c845a1306', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16471338-1b53-4c14-b249-6cb7e3f22b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16471338-1b53-4c14-b249-6cb7e3f22b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2156dcca-1c6b-4b24-895d-08c993475c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:36 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Volume 71fac08a-69b3-432e-ad11-aa5c845a1306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71fac08a-69b3-432e-ad11-aa5c845a1306', 'volume_size': 1}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:36 devstack sudo[108713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8
Aug 04 09:37:36 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:36 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8" returned: 0 in 0.283s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.484s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-495356417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e26577-b59e-4972-b9be-3bc84286187f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3747d58e4b44f0ab761bca4e5964be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:35Z,use_quota=True,user_id='d8196d42ab7a425e8967c24e73fa31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Creating volume e9e26577-b59e-4972-b9be-3bc84286187f {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:36 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9e26577-b59e-4972-b9be-3bc84286187f 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6940ebf6-9e09-48c3-b588-da6d8392bdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ae45b4-dff7-475c-9d58-61c267017a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:36 devstack sudo[108716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9e26577-b59e-4972-b9be-3bc84286187f 1073741824
Aug 04 09:37:36 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:36 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Volume volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8 (fe6be499-d61e-4d8f-a6eb-c8770c7f78d8): created successfully
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ae45b4-dff7-475c-9d58-61c267017a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Flow 'volume_create_manager' (dd719a60-c5e3-4c1e-88dd-0d585b7437a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-7dc8fc5e-6067-4312-b4bd-9f7669ee934f tempest-CreateVolumesFromImageTest-483980240 None] Created volume successfully.
Aug 04 09:37:37 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9e26577-b59e-4972-b9be-3bc84286187f 1073741824" returned: 0 in 0.526s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9e26577-b59e-4972-b9be-3bc84286187f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:37 devstack sudo[108721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9e26577-b59e-4972-b9be-3bc84286187f
Aug 04 09:37:37 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:37 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9e26577-b59e-4972-b9be-3bc84286187f" returned: 0 in 0.313s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.139s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-52622611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc973c2-51f9-4f40-bcc9-2722ce5fc29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff12b7bf45045d9b63d5b52e205871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:35Z,use_quota=True,user_id='e99b062340964d39be27e2fdfa4b4b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Creating volume bcc973c2-51f9-4f40-bcc9-2722ce5fc29b {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:37 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bcfb135-0503-4813-8873-7176d8f94a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e26577-b59e-4972-b9be-3bc84286187f', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:37 devstack sudo[108724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b 1073741824
Aug 04 09:37:37 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633b4b75-7fce-4d5b-8c69-bf735634116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:37 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume volume-e9e26577-b59e-4972-b9be-3bc84286187f (e9e26577-b59e-4972-b9be-3bc84286187f): created successfully
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633b4b75-7fce-4d5b-8c69-bf735634116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Flow 'volume_create_manager' (2806b38f-ca00-400b-ab2d-dc6d3bdfc906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-987e5441-b86a-4ada-9b3d-1c25bd0df742 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Created volume successfully.
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Flow 'volume_create_manager' (39531d84-52ca-4b75-b353-5ec4ad26e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc24a7c-44bf-41a3-8782-65e6528b53d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc24a7c-44bf-41a3-8782-65e6528b53d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358bdb6b-c110-40f4-952d-548fdf27d27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6392586a24bfdbad22e36198d8b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:38Z,use_quota=True,user_id='50305d458c694c3a9ba4d5454066ae6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca69926-2e07-4566-844c-5eaefbea5175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca69926-2e07-4566-844c-5eaefbea5175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1111e56-3aaa-4cdd-af9e-eb477ef66fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.image.glance [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Creating Keystone auth plugin from conf {{(pid=88880) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1111e56-3aaa-4cdd-af9e-eb477ef66fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '358bdb6b-c110-40f4-952d-548fdf27d27b', 'volume_name': 'volume-358bdb6b-c110-40f4-952d-548fdf27d27b', 'volume_size': 1, 'image_id': 'df40b706-fd3e-445e-9ac5-cc0d117ac631', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40b706-fd3e-445e-9ac5-cc0d117ac631', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '69bdf4f5aa882cc0947b5a39bf406615', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd9a6392586a24bfdbad22e36198d8b07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2653f990569650e48679630bdbd4dfa331c7043f4819fdf3f8b3c8417783108abd58778609fcc8071f0c3a85673ea5bdf21feced3f4142b07239864d02a80e13', 'id': 'df40b706-fd3e-445e-9ac5-cc0d117ac631', 'created_at': datetime.datetime(2026, 8, 4, 7, 37, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 37, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40b706-fd3e-445e-9ac5-cc0d117ac631/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba0ff9e0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46695d2a-6649-4e3c-b66c-7d9c6a6b0a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46695d2a-6649-4e3c-b66c-7d9c6a6b0a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:38 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d4e6ad-dfac-4ac4-a58a-60727a758ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:38 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Volume 358bdb6b-c110-40f4-952d-548fdf27d27b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-358bdb6b-c110-40f4-952d-548fdf27d27b', 'volume_size': 1, 'image_id': 'df40b706-fd3e-445e-9ac5-cc0d117ac631', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40b706-fd3e-445e-9ac5-cc0d117ac631', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '69bdf4f5aa882cc0947b5a39bf406615', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd9a6392586a24bfdbad22e36198d8b07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2653f990569650e48679630bdbd4dfa331c7043f4819fdf3f8b3c8417783108abd58778609fcc8071f0c3a85673ea5bdf21feced3f4142b07239864d02a80e13', 'id': 'df40b706-fd3e-445e-9ac5-cc0d117ac631', 'created_at': datetime.datetime(2026, 8, 4, 7, 37, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 37, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40b706-fd3e-445e-9ac5-cc0d117ac631/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba0ff9e0>}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Trying to clone 358bdb6b-c110-40f4-952d-548fdf27d27b from image df40b706-fd3e-445e-9ac5-cc0d117ac631 at location (None, [{'url': 'file:///opt/stack/data/glance/images/df40b706-fd3e-445e-9ac5-cc0d117ac631', 'metadata': {}}]). {{(pid=88880) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b 1073741824" returned: 0 in 0.565s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:38 devstack sudo[108730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b
Aug 04 09:37:38 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 04 09:37:38 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Image download 0.00 MB at 0.00 MB/s
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[94062b3b-7a8d-495b-b574-694851811e15]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:38 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b" returned: 0 in 0.369s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.632s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452914073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c511fc0a-b3ef-4261-a118-9c295caac09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff12b7bf45045d9b63d5b52e205871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:36Z,use_quota=True,user_id='e99b062340964d39be27e2fdfa4b4b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Creating volume c511fc0a-b3ef-4261-a118-9c295caac09d {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:38 devstack sudo[108732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD
Aug 04 09:37:38 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:38 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c511fc0a-b3ef-4261-a118-9c295caac09d 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:38 devstack sudo[108735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c511fc0a-b3ef-4261-a118-9c295caac09d 1073741824
Aug 04 09:37:38 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad48a3ea-8dfc-49de-b127-ac39a52e219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d732821-32d2-4f04-a520-27489c7ec616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Flow 'volume_create_manager' (5c84498b-3fbd-4bb3-9377-50b131e18b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ed9f30-eb3f-4bd7-beec-ca63d4695269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:38 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Volume volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b (bcc973c2-51f9-4f40-bcc9-2722ce5fc29b): created successfully
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d732821-32d2-4f04-a520-27489c7ec616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Flow 'volume_create_manager' (69097685-718a-40b8-9af1-b3b2ed606521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:39 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ddd24f03-b5c8-4831-af3d-c3dce774c361 tempest-CreateVolumesFromImageTest-483980240 None] Created volume successfully.
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ed9f30-eb3f-4bd7-beec-ca63d4695269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1392101367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0505d16f-18ac-449c-b844-b97205e68be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3747d58e4b44f0ab761bca4e5964be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:39Z,use_quota=True,user_id='d8196d42ab7a425e8967c24e73fa31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd313a99-9b6a-42ad-b53f-f669e0ee5260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd313a99-9b6a-42ad-b53f-f669e0ee5260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5b9049-9474-4221-8d16-bc290b804d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5b9049-9474-4221-8d16-bc290b804d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0505d16f-18ac-449c-b844-b97205e68be8', 'volume_name': 'volume-0505d16f-18ac-449c-b844-b97205e68be8', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38edd69-3249-469d-a2a4-cf7735f8759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38edd69-3249-469d-a2a4-cf7735f8759e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90666c3-f310-48e6-9618-ba5336821776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume 0505d16f-18ac-449c-b844-b97205e68be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0505d16f-18ac-449c-b844-b97205e68be8', 'volume_size': 1}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:39 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD" returned: 0 in 0.568s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:39 devstack sudo[108741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD
Aug 04 09:37:39 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:39 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c511fc0a-b3ef-4261-a118-9c295caac09d 1073741824" returned: 0 in 0.663s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Flow 'volume_create_manager' (8f15b6fa-493f-4756-8aad-111839c52cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794c1a42-6b2f-46d6-8754-05aeb05a2f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794c1a42-6b2f-46d6-8754-05aeb05a2f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-985074445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7effe5b5-f89f-49eb-b02d-ade477114ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3747d58e4b44f0ab761bca4e5964be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:39Z,use_quota=True,user_id='d8196d42ab7a425e8967c24e73fa31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3071455-ab6a-4ab9-a823-0699b8005e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3071455-ab6a-4ab9-a823-0699b8005e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b82357-9f9c-4750-8ac2-e4ef6feac8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b82357-9f9c-4750-8ac2-e4ef6feac8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7effe5b5-f89f-49eb-b02d-ade477114ad0', 'volume_name': 'volume-7effe5b5-f89f-49eb-b02d-ade477114ad0', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ba32fe-6081-44c4-b5e6-1a70d31ccdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ba32fe-6081-44c4-b5e6-1a70d31ccdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbd1d98-2777-4aab-b27e-cbf85c9501a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume 7effe5b5-f89f-49eb-b02d-ade477114ad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7effe5b5-f89f-49eb-b02d-ade477114ad0', 'volume_size': 1}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c511fc0a-b3ef-4261-a118-9c295caac09d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:39 devstack sudo[108745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c511fc0a-b3ef-4261-a118-9c295caac09d
Aug 04 09:37:39 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:39 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Flow 'volume_create_manager' (1b5ffa51-b625-4d17-851a-55b0a71981df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beeaa0fb-0e4d-40a5-9c8d-4ef0f8ddcf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD" returned: 1 in 0.537s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Temporary image df40b706-fd3e-445e-9ac5-cc0d117ac631 is fetched for user 50305d458c694c3a9ba4d5454066ae6c. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beeaa0fb-0e4d-40a5-9c8d-4ef0f8ddcf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792ff0c70e8b44a69fe091860cdb5657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:40Z,use_quota=True,user_id='b79b438d82bc4616b195ca6c3d16fed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c09b4444-9829-49d3-be34-8ba134143402),volume_type_id=c09b4444-9829-49d3-be34-8ba134143402)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf88819b-79b5-4a75-a0f2-0a4aecbea09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf88819b-79b5-4a75-a0f2-0a4aecbea09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da89536-da3d-452d-aef7-28c6de86049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.image.glance [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Creating Keystone auth plugin from conf {{(pid=88880) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Flow 'volume_create_manager' (39558a5a-9b3c-4a00-9533-2e95b4656423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22ae835-82ac-4d69-923a-230a42797ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c511fc0a-b3ef-4261-a118-9c295caac09d" returned: 0 in 0.266s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.340s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-767665761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71fac08a-69b3-432e-ad11-aa5c845a1306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ff12b7bf45045d9b63d5b52e205871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:36Z,use_quota=True,user_id='e99b062340964d39be27e2fdfa4b4b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Creating volume 71fac08a-69b3-432e-ad11-aa5c845a1306 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:39 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-71fac08a-69b3-432e-ad11-aa5c845a1306 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22ae835-82ac-4d69-923a-230a42797ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1471394799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4d93b1-960e-4c8a-ae5a-abf680055e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3747d58e4b44f0ab761bca4e5964be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:40Z,use_quota=True,user_id='d8196d42ab7a425e8967c24e73fa31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack sudo[108751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-71fac08a-69b3-432e-ad11-aa5c845a1306 1073741824
Aug 04 09:37:39 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86cb97b-1a78-4e05-9b68-8383ba4f9756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86cb97b-1a78-4e05-9b68-8383ba4f9756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea0d514-d71c-4455-bf29-c0790cef9318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea0d514-d71c-4455-bf29-c0790cef9318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4d93b1-960e-4c8a-ae5a-abf680055e4c', 'volume_name': 'volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70504cd1-a9a3-412f-8174-4099e7d0d658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:39 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70504cd1-a9a3-412f-8174-4099e7d0d658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd1ce4f-f892-4576-9ccd-55d153b83a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume bc4d93b1-960e-4c8a-ae5a-abf680055e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c', 'volume_size': 1}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6635638b-6f87-44b3-a217-3aa819b74556]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6584839a-db9b-4101-b2db-005163b64111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c511fc0a-b3ef-4261-a118-9c295caac09d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0c4774-875f-4394-aecb-ce2129e135a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Volume volume-c511fc0a-b3ef-4261-a118-9c295caac09d (c511fc0a-b3ef-4261-a118-9c295caac09d): created successfully
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0c4774-875f-4394-aecb-ce2129e135a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Flow 'volume_create_manager' (4c7e505b-e4be-4a59-8597-5cae97fb9d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:40 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-717911c7-8f93-432f-bf14-f5ddf4dfa809 tempest-CreateVolumesFromImageTest-483980240 None] Created volume successfully.
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da89536-da3d-452d-aef7-28c6de86049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f', 'volume_name': 'volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f', 'volume_size': 1, 'image_id': '3db1f454-af55-4199-b18d-1f5d41718598', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3db1f454-af55-4199-b18d-1f5d41718598', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7b90b697fbce7379db124aa8aa16706f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '792ff0c70e8b44a69fe091860cdb5657', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04d3eae974e43017ad8dbffdc062bac7e8eefa834994d9c1292012a88eb186dc36d67e7f99ba44fa0e60605f424fde27975b8f8265ca48e2ccccc5dd1217ab74', 'id': '3db1f454-af55-4199-b18d-1f5d41718598', 'created_at': datetime.datetime(2026, 8, 4, 7, 37, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 37, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3db1f454-af55-4199-b18d-1f5d41718598/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dafe5eb70>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0ad964-d6cb-45fc-85d0-6cec342f825f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack sudo[108754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD
Aug 04 09:37:40 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0ad964-d6cb-45fc-85d0-6cec342f825f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a41d3ed-b160-437a-b406-d5eb4997c740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Volume dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f', 'volume_size': 1, 'image_id': '3db1f454-af55-4199-b18d-1f5d41718598', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3db1f454-af55-4199-b18d-1f5d41718598', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7b90b697fbce7379db124aa8aa16706f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '792ff0c70e8b44a69fe091860cdb5657', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04d3eae974e43017ad8dbffdc062bac7e8eefa834994d9c1292012a88eb186dc36d67e7f99ba44fa0e60605f424fde27975b8f8265ca48e2ccccc5dd1217ab74', 'id': '3db1f454-af55-4199-b18d-1f5d41718598', 'created_at': datetime.datetime(2026, 8, 4, 7, 37, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 37, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3db1f454-af55-4199-b18d-1f5d41718598/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dafe5eb70>}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Trying to clone dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f from image 3db1f454-af55-4199-b18d-1f5d41718598 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3db1f454-af55-4199-b18d-1f5d41718598', 'metadata': {}}]). {{(pid=88880) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Flow 'volume_create_manager' (04aabcc7-6dd7-4141-94eb-b054629ae426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288dc03c-7d99-4fb3-b4b6-de457b00afc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288dc03c-7d99-4fb3-b4b6-de457b00afc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1945369819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69f1b36-6312-407d-84f9-de96978a2a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3747d58e4b44f0ab761bca4e5964be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:40Z,use_quota=True,user_id='d8196d42ab7a425e8967c24e73fa31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593dec9d-91c6-43d6-86d4-c7a9e1470939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593dec9d-91c6-43d6-86d4-c7a9e1470939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0b1150-4262-437e-ba90-8349451e232e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0b1150-4262-437e-ba90-8349451e232e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69f1b36-6312-407d-84f9-de96978a2a85', 'volume_name': 'volume-f69f1b36-6312-407d-84f9-de96978a2a85', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316e7d43-9e5a-4f8f-8e8a-fb3d91a94aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316e7d43-9e5a-4f8f-8e8a-fb3d91a94aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5662656c-fbca-466d-9d4f-27b71be1db04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume f69f1b36-6312-407d-84f9-de96978a2a85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69f1b36-6312-407d-84f9-de96978a2a85', 'volume_size': 1}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 04 09:37:40 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Image download 0.00 MB at 0.00 MB/s
Aug 04 09:37:40 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-71fac08a-69b3-432e-ad11-aa5c845a1306 1073741824" returned: 0 in 0.646s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:40 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD" returned: 0 in 0.594s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[896e2e55-3b23-4e4b-856c-6b56238de9d5]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-71fac08a-69b3-432e-ad11-aa5c845a1306 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:40 devstack sudo[108767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-71fac08a-69b3-432e-ad11-aa5c845a1306
Aug 04 09:37:40 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:40 devstack sudo[108765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD
Aug 04 09:37:40 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:40 devstack sudo[108766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD
Aug 04 09:37:40 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Flow 'volume_create_manager' (cbc5a184-3faa-4ff7-b50c-2277671c2d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ee7d3f-b0bb-4173-a6e7-b86830449ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ee7d3f-b0bb-4173-a6e7-b86830449ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762644159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a274e810-a6dc-4007-85c4-6f4a436f1990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3747d58e4b44f0ab761bca4e5964be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:41Z,use_quota=True,user_id='d8196d42ab7a425e8967c24e73fa31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c499df29-0453-4ebb-b2dc-77e924401f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c499df29-0453-4ebb-b2dc-77e924401f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a783eb-d416-4f01-b55e-ba6e94df853b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a783eb-d416-4f01-b55e-ba6e94df853b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a274e810-a6dc-4007-85c4-6f4a436f1990', 'volume_name': 'volume-a274e810-a6dc-4007-85c4-6f4a436f1990', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7795b632-2e19-4f12-a7aa-b400ee24d93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7795b632-2e19-4f12-a7aa-b400ee24d93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afd8dfb-171f-4672-a2bd-9ea92f301294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:40 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume a274e810-a6dc-4007-85c4-6f4a436f1990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a274e810-a6dc-4007-85c4-6f4a436f1990', 'volume_size': 1}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD" returned: 1 in 0.388s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-71fac08a-69b3-432e-ad11-aa5c845a1306" returned: 0 in 0.337s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.896s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1392101367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0505d16f-18ac-449c-b844-b97205e68be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3747d58e4b44f0ab761bca4e5964be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:39Z,use_quota=True,user_id='d8196d42ab7a425e8967c24e73fa31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Creating volume 0505d16f-18ac-449c-b844-b97205e68be8 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:41 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:41 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0505d16f-18ac-449c-b844-b97205e68be8 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:41 devstack sudo[108777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0505d16f-18ac-449c-b844-b97205e68be8 1073741824
Aug 04 09:37:41 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2156dcca-1c6b-4b24-895d-08c993475c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71fac08a-69b3-432e-ad11-aa5c845a1306', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0cc240-b4f7-4e8d-8e98-293981f145d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:41 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Volume volume-71fac08a-69b3-432e-ad11-aa5c845a1306 (71fac08a-69b3-432e-ad11-aa5c845a1306): created successfully
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0cc240-b4f7-4e8d-8e98-293981f145d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Flow 'volume_create_manager' (a7aa789a-8730-4cda-adeb-d4798b367fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:41 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-fd6c53fd-8165-484d-a9e2-62fe17cfe0b1 tempest-CreateVolumesFromImageTest-483980240 None] Created volume successfully.
Aug 04 09:37:41 devstack sudo[108778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD
Aug 04 09:37:41 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:41 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD" returned: 1 in 0.329s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Temporary image 3db1f454-af55-4199-b18d-1f5d41718598 is fetched for user b79b438d82bc4616b195ca6c3d16fed2. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d2513e-7963-44ae-959e-baa787bb4c70]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:41 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0505d16f-18ac-449c-b844-b97205e68be8 1073741824" returned: 0 in 0.419s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0505d16f-18ac-449c-b844-b97205e68be8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:41 devstack sudo[108789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0505d16f-18ac-449c-b844-b97205e68be8
Aug 04 09:37:41 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:41 devstack sudo[108788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD
Aug 04 09:37:41 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "cinder-71fac08a-69b3-432e-ad11-aa5c845a1306-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-71fac08a-69b3-432e-ad11-aa5c845a1306-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:41 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0505d16f-18ac-449c-b844-b97205e68be8" returned: 0 in 0.277s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.107s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-985074445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7effe5b5-f89f-49eb-b02d-ade477114ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3747d58e4b44f0ab761bca4e5964be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:39Z,use_quota=True,user_id='d8196d42ab7a425e8967c24e73fa31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Creating volume 7effe5b5-f89f-49eb-b02d-ade477114ad0 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:41 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7effe5b5-f89f-49eb-b02d-ade477114ad0 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:41 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:41 devstack sudo[108795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7effe5b5-f89f-49eb-b02d-ade477114ad0 1073741824
Aug 04 09:37:41 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90666c3-f310-48e6-9618-ba5336821776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0505d16f-18ac-449c-b844-b97205e68be8', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc5bfaf-d0ab-4685-be69-72e8c5628680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "cinder-quobyte-71fac08a-69b3-432e-ad11-aa5c845a1306" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:41 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume volume-0505d16f-18ac-449c-b844-b97205e68be8 (0505d16f-18ac-449c-b844-b97205e68be8): created successfully
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc5bfaf-d0ab-4685-be69-72e8c5628680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Flow 'volume_create_manager' (5c84498b-3fbd-4bb3-9377-50b131e18b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:41 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-60f2ef09-404f-4145-8402-c32cea8872e7 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Created volume successfully.
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-quobyte-71fac08a-69b3-432e-ad11-aa5c845a1306" acquired by "delete_volume" :: waited 0.033s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2722f700-8723-4099-859a-96c4d95073ae]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-71fac08a-69b3-432e-ad11-aa5c845a1306 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:41 devstack sudo[108797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD
Aug 04 09:37:41 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:42 devstack sudo[108798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-71fac08a-69b3-432e-ad11-aa5c845a1306
Aug 04 09:37:42 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:42 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD" returned: 1 in 0.353s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:42 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7effe5b5-f89f-49eb-b02d-ade477114ad0 1073741824" returned: 0 in 0.436s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7effe5b5-f89f-49eb-b02d-ade477114ad0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:42 devstack sudo[108808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7effe5b5-f89f-49eb-b02d-ade477114ad0
Aug 04 09:37:42 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:42 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-71fac08a-69b3-432e-ad11-aa5c845a1306" returned: 0 in 0.393s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-71fac08a-69b3-432e-ad11-aa5c845a1306 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:42 devstack sudo[108812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-71fac08a-69b3-432e-ad11-aa5c845a1306
Aug 04 09:37:42 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:42 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7effe5b5-f89f-49eb-b02d-ade477114ad0" returned: 0 in 0.241s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.475s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1471394799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4d93b1-960e-4c8a-ae5a-abf680055e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3747d58e4b44f0ab761bca4e5964be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:40Z,use_quota=True,user_id='d8196d42ab7a425e8967c24e73fa31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Creating volume bc4d93b1-960e-4c8a-ae5a-abf680055e4c {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:42 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbd1d98-2777-4aab-b27e-cbf85c9501a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7effe5b5-f89f-49eb-b02d-ade477114ad0', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:42 devstack sudo[108815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c 1073741824
Aug 04 09:37:42 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb629919-1e4d-4b77-b7f1-0934be3d6c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:42 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume volume-7effe5b5-f89f-49eb-b02d-ade477114ad0 (7effe5b5-f89f-49eb-b02d-ade477114ad0): created successfully
Aug 04 09:37:42 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb629919-1e4d-4b77-b7f1-0934be3d6c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Flow 'volume_create_manager' (8f15b6fa-493f-4756-8aad-111839c52cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-71fac08a-69b3-432e-ad11-aa5c845a1306" returned: 0 in 0.253s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-quobyte-71fac08a-69b3-432e-ad11-aa5c845a1306" released by "delete_volume" :: held 0.700s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:42 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-5ac2812b-7ecd-4e75-b28a-d7d381d0d0cd tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Created volume successfully.
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Created reservations ['940813b8-add8-4f71-9103-8b1b53b10319', '38e73f22-4620-43f7-b239-1631623f86fc', 'f8053c73-a692-479a-b1a7-2b79826f36e2', '7589e5c3-1556-4ff3-b48e-b0c57b8de8c2'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:42 devstack sudo[108818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:42 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "cinder-c511fc0a-b3ef-4261-a118-9c295caac09d-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-c511fc0a-b3ef-4261-a118-9c295caac09d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:42 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "cinder-quobyte-c511fc0a-b3ef-4261-a118-9c295caac09d" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-quobyte-c511fc0a-b3ef-4261-a118-9c295caac09d" acquired by "delete_volume" :: waited 0.014s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:43 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.305s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:43 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36e967f-b6a9-41ea-9d46-044e1fd9c8df]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:43 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Deleted volume successfully.
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c511fc0a-b3ef-4261-a118-9c295caac09d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c 1073741824" returned: 0 in 0.560s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-094ba165-11f9-414b-b511-a7ee5b0af676 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-71fac08a-69b3-432e-ad11-aa5c845a1306-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:43 devstack sudo[108825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c
Aug 04 09:37:43 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:43 devstack sudo[108824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c511fc0a-b3ef-4261-a118-9c295caac09d
Aug 04 09:37:43 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:43 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c" returned: 0 in 0.237s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.824s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1945369819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69f1b36-6312-407d-84f9-de96978a2a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3747d58e4b44f0ab761bca4e5964be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:40Z,use_quota=True,user_id='d8196d42ab7a425e8967c24e73fa31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Creating volume f69f1b36-6312-407d-84f9-de96978a2a85 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:43 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f69f1b36-6312-407d-84f9-de96978a2a85 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd1ce4f-f892-4576-9ccd-55d153b83a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:43 devstack sudo[108832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f69f1b36-6312-407d-84f9-de96978a2a85 1073741824
Aug 04 09:37:43 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998850cb-5101-4a7d-9351-b3f0a63cd300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:43 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:43 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c (bc4d93b1-960e-4c8a-ae5a-abf680055e4c): created successfully
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998850cb-5101-4a7d-9351-b3f0a63cd300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Flow 'volume_create_manager' (39558a5a-9b3c-4a00-9533-2e95b4656423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c511fc0a-b3ef-4261-a118-9c295caac09d" returned: 0 in 0.373s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c511fc0a-b3ef-4261-a118-9c295caac09d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:43 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-05a0e74e-6f96-4959-979b-b14b538c416a tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Created volume successfully.
Aug 04 09:37:43 devstack sudo[108834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c511fc0a-b3ef-4261-a118-9c295caac09d
Aug 04 09:37:43 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:43 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c511fc0a-b3ef-4261-a118-9c295caac09d" returned: 0 in 0.256s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-quobyte-c511fc0a-b3ef-4261-a118-9c295caac09d" released by "delete_volume" :: held 0.681s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Created reservations ['bdce1f87-66c9-4a01-9481-2dbfd5e74a94', 'ba9e3f1d-e7ac-44e6-b2da-fbd639a3a6e2', 'a2d702bf-cb7c-4629-8f0b-9a624e76a74f', 'b2c0b2fb-cd61-4d28-9c93-112b219396c6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:43 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f69f1b36-6312-407d-84f9-de96978a2a85 1073741824" returned: 0 in 0.418s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f69f1b36-6312-407d-84f9-de96978a2a85 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:43 devstack sudo[108841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:43 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:43 devstack sudo[108842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f69f1b36-6312-407d-84f9-de96978a2a85
Aug 04 09:37:43 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:44 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.248s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:44 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Deleted volume successfully.
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f69f1b36-6312-407d-84f9-de96978a2a85" returned: 0 in 0.259s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.096s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762644159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a274e810-a6dc-4007-85c4-6f4a436f1990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3747d58e4b44f0ab761bca4e5964be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:41Z,use_quota=True,user_id='d8196d42ab7a425e8967c24e73fa31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Creating volume a274e810-a6dc-4007-85c4-6f4a436f1990 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:44 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a274e810-a6dc-4007-85c4-6f4a436f1990 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "cinder-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:44 devstack sudo[108847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a274e810-a6dc-4007-85c4-6f4a436f1990 1073741824
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5662656c-fbca-466d-9d4f-27b71be1db04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69f1b36-6312-407d-84f9-de96978a2a85', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:44 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9030134-c664-4d24-ab0f-0cfd17614484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-69bcbb67-703e-4822-b094-35d10bc97436 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-c511fc0a-b3ef-4261-a118-9c295caac09d-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:44 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume volume-f69f1b36-6312-407d-84f9-de96978a2a85 (f69f1b36-6312-407d-84f9-de96978a2a85): created successfully
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9030134-c664-4d24-ab0f-0cfd17614484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Flow 'volume_create_manager' (04aabcc7-6dd7-4141-94eb-b054629ae426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-05b846e1-9583-40b2-8de0-62e084ee41db tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Created volume successfully.
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "cinder-quobyte-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-quobyte-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3d4f8c-e236-4e44-8fdd-0a9d5237da53]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:44 devstack sudo[108849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b
Aug 04 09:37:44 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:44 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a274e810-a6dc-4007-85c4-6f4a436f1990 1073741824" returned: 0 in 0.472s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a274e810-a6dc-4007-85c4-6f4a436f1990 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:44 devstack sudo[108859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a274e810-a6dc-4007-85c4-6f4a436f1990
Aug 04 09:37:44 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:44 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b" returned: 0 in 0.380s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:44 devstack sudo[108861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b
Aug 04 09:37:44 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:44 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a274e810-a6dc-4007-85c4-6f4a436f1990" returned: 0 in 0.258s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.902s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358bdb6b-c110-40f4-952d-548fdf27d27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6392586a24bfdbad22e36198d8b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:38Z,use_quota=True,user_id='50305d458c694c3a9ba4d5454066ae6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Creating volume 358bdb6b-c110-40f4-952d-548fdf27d27b {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:44 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:44 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afd8dfb-171f-4672-a2bd-9ea92f301294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a274e810-a6dc-4007-85c4-6f4a436f1990', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:44 devstack sudo[108865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b 1073741824
Aug 04 09:37:44 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27288048-7605-49e4-9508-a22be6bb25bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b" returned: 0 in 0.263s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:44 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Volume volume-a274e810-a6dc-4007-85c4-6f4a436f1990 (a274e810-a6dc-4007-85c4-6f4a436f1990): created successfully
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27288048-7605-49e4-9508-a22be6bb25bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Flow 'volume_create_manager' (cbc5a184-3faa-4ff7-b50c-2277671c2d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-quobyte-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b" released by "delete_volume" :: held 0.708s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:44 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-fb26458c-bbc4-42ee-947a-05bf70bf5920 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Created volume successfully.
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Created reservations ['130ea01f-9f27-4453-860c-cae922bab22b', '68d217e2-195a-46e6-8f48-6194b92d098a', 'd833901c-a954-4525-9c44-23a45efd46d1', 'dcb5a8a0-b99c-46cf-9f9e-751711d2841e'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:45 devstack sudo[108867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:45 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "cinder-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "cinder-quobyte-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:45 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.296s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-quobyte-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8" acquired by "delete_volume" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:45 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Deleted volume successfully.
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[11184ac2-aee7-4016-a546-1f9df178231d]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "cinder-a274e810-a6dc-4007-85c4-6f4a436f1990-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-808580f7-00d3-4179-a8f4-8520c42fcf30 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-bcc973c2-51f9-4f40-bcc9-2722ce5fc29b-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:45 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-a274e810-a6dc-4007-85c4-6f4a436f1990-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b 1073741824" returned: 0 in 0.576s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "cinder-quobyte-a274e810-a6dc-4007-85c4-6f4a436f1990" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:45 devstack sudo[108874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-quobyte-a274e810-a6dc-4007-85c4-6f4a436f1990" acquired by "delete_volume" :: waited 0.069s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:45 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:45 devstack sudo[108873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8
Aug 04 09:37:45 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e547eb2-5125-4643-9e7b-1c1f2a2d884b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a274e810-a6dc-4007-85c4-6f4a436f1990 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:45 devstack sudo[108877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a274e810-a6dc-4007-85c4-6f4a436f1990
Aug 04 09:37:45 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:45 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b" returned: 0 in 0.342s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.741s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792ff0c70e8b44a69fe091860cdb5657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:40Z,use_quota=True,user_id='b79b438d82bc4616b195ca6c3d16fed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c09b4444-9829-49d3-be34-8ba134143402),volume_type_id=c09b4444-9829-49d3-be34-8ba134143402)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Creating volume dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:45 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:45 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8" returned: 0 in 0.483s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:45 devstack sudo[108883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f 1073741824
Aug 04 09:37:45 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:45 devstack sudo[108884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8
Aug 04 09:37:45 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:45 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Attempting download of df40b706-fd3e-445e-9ac5-cc0d117ac631 ((None, [{'url': 'file:///opt/stack/data/glance/images/df40b706-fd3e-445e-9ac5-cc0d117ac631', 'metadata': {}}])) to volume 358bdb6b-c110-40f4-952d-548fdf27d27b. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7939281a-d5e7-4f5f-9f86-3fa4612f6294]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40b706-fd3e-445e-9ac5-cc0d117ac631_q7wjeo2d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:46 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a274e810-a6dc-4007-85c4-6f4a436f1990" returned: 0 in 0.418s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a274e810-a6dc-4007-85c4-6f4a436f1990 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:46 devstack sudo[108891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a274e810-a6dc-4007-85c4-6f4a436f1990
Aug 04 09:37:46 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:46 devstack sudo[108889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40b706-fd3e-445e-9ac5-cc0d117ac631_q7wjeo2d
Aug 04 09:37:46 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:46 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8" returned: 0 in 0.277s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-quobyte-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8" released by "delete_volume" :: held 0.813s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Created reservations ['6d24ea83-9c4e-41f5-9667-f0f74666da11', '1ecfe6e8-9deb-416c-92cf-b2ba360926d3', '51595006-93cb-44d0-a825-8045196bc235', 'd8745b80-880e-4ab8-ad14-aece1a03979b'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:46 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a274e810-a6dc-4007-85c4-6f4a436f1990" returned: 0 in 0.288s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-quobyte-a274e810-a6dc-4007-85c4-6f4a436f1990" released by "delete_volume" :: held 0.799s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:46 devstack sudo[108900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:46 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:46 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f 1073741824" returned: 0 in 0.515s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:46 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40b706-fd3e-445e-9ac5-cc0d117ac631_q7wjeo2d" returned: 0 in 0.422s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40b706-fd3e-445e-9ac5-cc0d117ac631_q7wjeo2d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:46 devstack sudo[108905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f
Aug 04 09:37:46 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "cinder-0454851f-79b0-492a-9169-042e5cc6a20e-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Created reservations ['27caada6-462b-45f5-ad47-51c85753c21e', '3181e3d0-0116-4639-ba2a-4c72f0f3a5ea', '9722a1e5-f6ff-46fc-ae84-8e1c336df278', 'f5bc0054-9a92-4e0f-893e-27367bb13e1e'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-0454851f-79b0-492a-9169-042e5cc6a20e-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:46 devstack sudo[108904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40b706-fd3e-445e-9ac5-cc0d117ac631_q7wjeo2d
Aug 04 09:37:46 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "cinder-quobyte-0454851f-79b0-492a-9169-042e5cc6a20e" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:46 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:46 devstack sudo[108909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.393s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:46 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-quobyte-0454851f-79b0-492a-9169-042e5cc6a20e" acquired by "delete_volume" :: waited 0.073s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:46 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Deleted volume successfully.
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[180f36dc-f3c6-484f-81df-b9346c537673]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0454851f-79b0-492a-9169-042e5cc6a20e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-385e965a-4589-41f1-bcd0-5f176f1a499e tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-fe6be499-d61e-4d8f-a6eb-c8770c7f78d8-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:46 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f" returned: 0 in 0.411s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Attempting download of 3db1f454-af55-4199-b18d-1f5d41718598 ((None, [{'url': 'file:///opt/stack/data/glance/images/3db1f454-af55-4199-b18d-1f5d41718598', 'metadata': {}}])) to volume dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 04 09:37:46 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40b706-fd3e-445e-9ac5-cc0d117ac631_q7wjeo2d" returned: 1 in 0.520s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40b706-fd3e-445e-9ac5-cc0d117ac631_q7wjeo2d' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcd5c16-0e62-4873-a1eb-7df182cdf7e4]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[469230be-c80e-47f0-b046-0ae7aa710a77]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3db1f454-af55-4199-b18d-1f5d41718598_tiipu023 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:47 devstack sudo[108926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0454851f-79b0-492a-9169-042e5cc6a20e
Aug 04 09:37:47 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:47 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.358s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:47 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Deleted volume successfully.
Aug 04 09:37:47 devstack sudo[108949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD
Aug 04 09:37:47 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a3972e9e-4d3e-41ca-900d-9e963168de9d tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-a274e810-a6dc-4007-85c4-6f4a436f1990-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:47 devstack sudo[108951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3db1f454-af55-4199-b18d-1f5d41718598_tiipu023
Aug 04 09:37:47 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:47 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0454851f-79b0-492a-9169-042e5cc6a20e" returned: 0 in 0.515s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0454851f-79b0-492a-9169-042e5cc6a20e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:47 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:47 devstack sudo[108962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0454851f-79b0-492a-9169-042e5cc6a20e
Aug 04 09:37:47 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:47 devstack sudo[108963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD
Aug 04 09:37:47 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:47 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3db1f454-af55-4199-b18d-1f5d41718598_tiipu023" returned: 0 in 0.435s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3db1f454-af55-4199-b18d-1f5d41718598_tiipu023 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:47 devstack sudo[108968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3db1f454-af55-4199-b18d-1f5d41718598_tiipu023
Aug 04 09:37:47 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:47 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0454851f-79b0-492a-9169-042e5cc6a20e" returned: 0 in 0.270s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-quobyte-0454851f-79b0-492a-9169-042e5cc6a20e" released by "delete_volume" :: held 0.857s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Created reservations ['b6cbcd78-0dd0-4b03-b7af-6fcdd250a52e', '7ea7d6d7-50ad-48f9-a89b-c354eb842aba', 'abd7908a-f57b-4b11-a049-776ce1b7d25c', '8be43e0e-2ab6-46dd-8225-2a56183dd238'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:47 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "cinder-f69f1b36-6312-407d-84f9-de96978a2a85-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD" returned: 1 in 0.407s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] df40b706-fd3e-445e-9ac5-cc0d117ac631 was raw, converting to raw {{(pid=88880) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:47 devstack sudo[108974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b
Aug 04 09:37:47 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-f69f1b36-6312-407d-84f9-de96978a2a85-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:47 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3db1f454-af55-4199-b18d-1f5d41718598_tiipu023" returned: 1 in 0.372s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3db1f454-af55-4199-b18d-1f5d41718598_tiipu023' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f5bd1c-34d2-4760-924b-cf61d97dada4]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "cinder-quobyte-f69f1b36-6312-407d-84f9-de96978a2a85" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-quobyte-f69f1b36-6312-407d-84f9-de96978a2a85" acquired by "delete_volume" :: waited 0.040s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:47 devstack sudo[108979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:47 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f3dc8e-aaf6-4632-9e98-ff7b66ce79af]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:47 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f69f1b36-6312-407d-84f9-de96978a2a85 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:48 devstack sudo[108978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD
Aug 04 09:37:48 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:48 devstack sudo[108981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f69f1b36-6312-407d-84f9-de96978a2a85
Aug 04 09:37:48 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:48 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b" returned: 0 in 0.386s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df40b706-fd3e-445e-9ac5-cc0d117ac631_r5gmqp20devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:37:48 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Converted 0.00 MB image at 0.00 MB/s
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:48 devstack sudo[108988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b 1G
Aug 04 09:37:48 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:48 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.293s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:48 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Deleted volume successfully.
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-19bd78cf-9af5-43ca-a4c8-8374178ebc91 tempest-CreateVolumesFromImageTest-483980240 None] Lock "cinder-0454851f-79b0-492a-9169-042e5cc6a20e-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:48 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD" returned: 0 in 0.415s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:48 devstack sudo[108992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD
Aug 04 09:37:48 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:48 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f69f1b36-6312-407d-84f9-de96978a2a85" returned: 0 in 0.448s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f69f1b36-6312-407d-84f9-de96978a2a85 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:48 devstack sudo[108999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f69f1b36-6312-407d-84f9-de96978a2a85
Aug 04 09:37:48 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:48 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b 1G" returned: 0 in 0.364s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cf5ce0-c049-49c5-b6eb-77c00b224cc2]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:48 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD" returned: 1 in 0.354s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] 3db1f454-af55-4199-b18d-1f5d41718598 was raw, converting to raw {{(pid=88880) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:48 devstack sudo[109006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f
Aug 04 09:37:48 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:48 devstack sudo[109002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b
Aug 04 09:37:48 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:48 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f69f1b36-6312-407d-84f9-de96978a2a85" returned: 0 in 0.295s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-quobyte-f69f1b36-6312-407d-84f9-de96978a2a85" released by "delete_volume" :: held 0.789s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Created reservations ['cb2fceb6-a9f4-458f-a09d-006b06380d68', '9c649a19-1d85-477f-a59c-17b321b8366d', 'cbccfb4d-23e8-458d-a4b8-655e5b046354', 'ec1f9544-9211-4f1c-9a8c-6cadf88b9719'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:49 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b" returned: 0 in 0.442s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:49 devstack sudo[109015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:49 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "cinder-bc4d93b1-960e-4c8a-ae5a-abf680055e4c-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-bc4d93b1-960e-4c8a-ae5a-abf680055e4c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "cinder-quobyte-bc4d93b1-960e-4c8a-ae5a-abf680055e4c" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-quobyte-bc4d93b1-960e-4c8a-ae5a-abf680055e4c" acquired by "delete_volume" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:49 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f" returned: 0 in 0.552s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3db1f454-af55-4199-b18d-1f5d41718598_66y4nx19devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:37:49 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Converted 0.00 MB image at 0.00 MB/s
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a958c31-4f5b-4ee2-9205-8cb32226ff05]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:49 devstack sudo[109018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f 1G
Aug 04 09:37:49 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:49 devstack sudo[109016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b
Aug 04 09:37:49 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:49 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.415s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:49 devstack sudo[109019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c
Aug 04 09:37:49 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:49 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Deleted volume successfully.
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4cfdb68e-589c-4d11-a69a-15424ebb4d06 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-f69f1b36-6312-407d-84f9-de96978a2a85-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:49 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f 1G" returned: 0 in 0.397s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[afca8487-6691-4252-9e1a-9d06dcd652ee]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:49 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b" returned: 1 in 0.659s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Downloaded image df40b706-fd3e-445e-9ac5-cc0d117ac631 ((None, [{'url': 'file:///opt/stack/data/glance/images/df40b706-fd3e-445e-9ac5-cc0d117ac631', 'metadata': {}}])) to volume 358bdb6b-c110-40f4-952d-548fdf27d27b successfully. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Temporary image df40b706-fd3e-445e-9ac5-cc0d117ac631 for user 50305d458c694c3a9ba4d5454066ae6c is deleted. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Marking volume 358bdb6b-c110-40f4-952d-548fdf27d27b as bootable. {{(pid=88880) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 04 09:37:49 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c" returned: 0 in 0.485s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Copying metadata from image df40b706-fd3e-445e-9ac5-cc0d117ac631 to 358bdb6b-c110-40f4-952d-548fdf27d27b. {{(pid=88880) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Creating volume glance metadata for volume 358bdb6b-c110-40f4-952d-548fdf27d27b backed by image df40b706-fd3e-445e-9ac5-cc0d117ac631 with: {'image_id': 'df40b706-fd3e-445e-9ac5-cc0d117ac631', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '69bdf4f5aa882cc0947b5a39bf406615', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88880) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 04 09:37:49 devstack sudo[109034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c
Aug 04 09:37:49 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:49 devstack sudo[109033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f
Aug 04 09:37:49 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d4e6ad-dfac-4ac4-a58a-60727a758ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-358bdb6b-c110-40f4-952d-548fdf27d27b', 'volume_size': 1, 'image_id': 'df40b706-fd3e-445e-9ac5-cc0d117ac631', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40b706-fd3e-445e-9ac5-cc0d117ac631', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '69bdf4f5aa882cc0947b5a39bf406615', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd9a6392586a24bfdbad22e36198d8b07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2653f990569650e48679630bdbd4dfa331c7043f4819fdf3f8b3c8417783108abd58778609fcc8071f0c3a85673ea5bdf21feced3f4142b07239864d02a80e13', 'id': 'df40b706-fd3e-445e-9ac5-cc0d117ac631', 'created_at': datetime.datetime(2026, 8, 4, 7, 37, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 37, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40b706-fd3e-445e-9ac5-cc0d117ac631/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dba0ff9e0>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf004b4a-8142-4b36-a029-d2a08e52f698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:49 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Volume volume-358bdb6b-c110-40f4-952d-548fdf27d27b (358bdb6b-c110-40f4-952d-548fdf27d27b): created successfully
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf004b4a-8142-4b36-a029-d2a08e52f698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:49 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Flow 'volume_create_manager' (39531d84-52ca-4b75-b353-5ec4ad26e46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:49 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-153941c0-21b4-4c8a-b29a-291d94d15dfa tempest-VolumeImageDependencyTests-462562420 None] Created volume successfully.
Aug 04 09:37:50 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-bc4d93b1-960e-4c8a-ae5a-abf680055e4c" returned: 0 in 0.328s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-quobyte-bc4d93b1-960e-4c8a-ae5a-abf680055e4c" released by "delete_volume" :: held 0.893s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:50 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f" returned: 0 in 0.477s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Created reservations ['96a8f737-d8e2-4ec7-8720-aa92f8f8bc0c', '2617d165-b1af-4a00-9de5-e293343ec4a9', '105a9cd0-466a-4097-8a7b-bee168a25ec4', 'd9ceebd8-a2b3-4dea-aa06-d176fbde4b6c'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Acquiring lock "cinder-358bdb6b-c110-40f4-952d-548fdf27d27b-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Lock "cinder-358bdb6b-c110-40f4-952d-548fdf27d27b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:50 devstack sudo[109041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f
Aug 04 09:37:50 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Acquiring lock "cinder-quobyte-358bdb6b-c110-40f4-952d-548fdf27d27b" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:50 devstack sudo[109043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:50 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Lock "cinder-quobyte-358bdb6b-c110-40f4-952d-548fdf27d27b" acquired by "delete_volume" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "cinder-7effe5b5-f89f-49eb-b02d-ade477114ad0-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-7effe5b5-f89f-49eb-b02d-ade477114ad0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc9cf96-98fe-4acc-91de-16b9faebaabe]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "cinder-quobyte-7effe5b5-f89f-49eb-b02d-ade477114ad0" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-quobyte-7effe5b5-f89f-49eb-b02d-ade477114ad0" acquired by "delete_volume" :: waited 0.033s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff873ace-70e5-47d6-9787-8eb5ab59faf8]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7effe5b5-f89f-49eb-b02d-ade477114ad0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:50 devstack sudo[109045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b
Aug 04 09:37:50 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:50 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f" returned: 1 in 0.559s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Downloaded image 3db1f454-af55-4199-b18d-1f5d41718598 ((None, [{'url': 'file:///opt/stack/data/glance/images/3db1f454-af55-4199-b18d-1f5d41718598', 'metadata': {}}])) to volume dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f successfully. {{(pid=88880) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Temporary image 3db1f454-af55-4199-b18d-1f5d41718598 for user b79b438d82bc4616b195ca6c3d16fed2 is deleted. {{(pid=88880) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.volume.volume_utils [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Marking volume dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f as bootable. {{(pid=88880) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 04 09:37:50 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.385s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Copying metadata from image 3db1f454-af55-4199-b18d-1f5d41718598 to dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f. {{(pid=88880) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Creating volume glance metadata for volume dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f backed by image 3db1f454-af55-4199-b18d-1f5d41718598 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3db1f454-af55-4199-b18d-1f5d41718598', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7b90b697fbce7379db124aa8aa16706f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88880) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 04 09:37:50 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Deleted volume successfully.
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9123fa2b-d56b-4d21-b93a-970e82317a1e tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-bc4d93b1-960e-4c8a-ae5a-abf680055e4c-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:50 devstack sudo[109050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7effe5b5-f89f-49eb-b02d-ade477114ad0
Aug 04 09:37:50 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a41d3ed-b160-437a-b406-d5eb4997c740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f', 'volume_size': 1, 'image_id': '3db1f454-af55-4199-b18d-1f5d41718598', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3db1f454-af55-4199-b18d-1f5d41718598', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7b90b697fbce7379db124aa8aa16706f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '792ff0c70e8b44a69fe091860cdb5657', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04d3eae974e43017ad8dbffdc062bac7e8eefa834994d9c1292012a88eb186dc36d67e7f99ba44fa0e60605f424fde27975b8f8265ca48e2ccccc5dd1217ab74', 'id': '3db1f454-af55-4199-b18d-1f5d41718598', 'created_at': datetime.datetime(2026, 8, 4, 7, 37, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 4, 7, 37, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3db1f454-af55-4199-b18d-1f5d41718598/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5dafe5eb70>}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c252ae-5b9c-43f3-8be2-99c774e74849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:50 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Volume volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f (dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f): created successfully
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c252ae-5b9c-43f3-8be2-99c774e74849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Flow 'volume_create_manager' (1b5ffa51-b625-4d17-851a-55b0a71981df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:50 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a195c634-d1f4-4996-9d2e-f866e0e1be89 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Created volume successfully.
Aug 04 09:37:51 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b" returned: 0 in 0.533s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:51 devstack sudo[109055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b
Aug 04 09:37:51 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:51 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7effe5b5-f89f-49eb-b02d-ade477114ad0" returned: 0 in 0.540s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7effe5b5-f89f-49eb-b02d-ade477114ad0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:51 devstack sudo[109060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7effe5b5-f89f-49eb-b02d-ade477114ad0
Aug 04 09:37:51 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:51 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b" returned: 1 in 0.413s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:51 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-7effe5b5-f89f-49eb-b02d-ade477114ad0" returned: 0 in 0.276s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:51 devstack sudo[109066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b
Aug 04 09:37:51 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-quobyte-7effe5b5-f89f-49eb-b02d-ade477114ad0" released by "delete_volume" :: held 0.890s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Acquiring lock "cinder-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Lock "cinder-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Acquiring lock "cinder-quobyte-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Created reservations ['e87a4b5e-a333-4e39-9353-9f75e26534d3', 'c185bdf2-a3d3-49bd-8427-742d63991de8', '79c45c4d-0eeb-49cb-b397-efc504a0ed5e', 'c0dfbd8c-0fea-459f-b2e3-fc8559c0bd36'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Lock "cinder-quobyte-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f" acquired by "delete_volume" :: waited 0.030s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcee160c-f49c-45eb-b4bf-865dea6bae3d]: (4, 'raw') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:51 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-358bdb6b-c110-40f4-952d-548fdf27d27b" returned: 0 in 0.334s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:51 devstack sudo[109070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Lock "cinder-quobyte-358bdb6b-c110-40f4-952d-548fdf27d27b" released by "delete_volume" :: held 1.396s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:51 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:51 devstack sudo[109069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f
Aug 04 09:37:51 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Created reservations ['06cfe3c4-3b12-4c3d-98b2-85d7847a197b', '38510a0c-22b1-443a-a4d3-79dd2f566478', '19bb6cf4-2cd6-4e79-806e-cae06f0f893b', 'ad36562f-9531-4c2a-b8eb-4797d0cbfdc4'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:51 devstack sudo[109073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:51 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:52 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.305s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:52 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Deleted volume successfully.
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-d708462a-7a73-408b-b229-69833bf94c9c tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-7effe5b5-f89f-49eb-b02d-ade477114ad0-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:52 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f" returned: 0 in 0.440s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:52 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.255s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:52 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Deleted volume successfully.
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-02b7ec0c-f7b8-4bc7-a3ea-4c004d770f4c tempest-VolumeImageDependencyTests-462562420 None] Lock "cinder-358bdb6b-c110-40f4-952d-548fdf27d27b-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:52 devstack sudo[109078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f
Aug 04 09:37:52 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:52 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f" returned: 1 in 0.360s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f' failed. Not Retrying. {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:52 devstack sudo[109084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f
Aug 04 09:37:52 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "cinder-0505d16f-18ac-449c-b844-b97205e68be8-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-0505d16f-18ac-449c-b844-b97205e68be8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:52 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "cinder-quobyte-0505d16f-18ac-449c-b844-b97205e68be8" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f" returned: 0 in 0.368s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Lock "cinder-quobyte-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f" released by "delete_volume" :: held 1.260s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-quobyte-0505d16f-18ac-449c-b844-b97205e68be8" acquired by "delete_volume" :: waited 0.033s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f25542-af48-4d4e-a57d-74d2b90dbcec]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0505d16f-18ac-449c-b844-b97205e68be8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:52 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Created reservations ['7b3fdc70-d971-4926-b84c-7f941db2308f', '4491d85b-4ad3-45a6-b337-05513aa189db', '39be8926-2a7f-4c38-a16e-2d140e90678b', 'c0097f04-515d-49e6-b9a0-a6afefa65786'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Flow 'volume_create_manager' (9352932a-2b60-4df7-afd4-a356685329aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2915177c-a328-4fdd-9342-fdef78e590de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2915177c-a328-4fdd-9342-fdef78e590de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1516201201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed36d56c-3707-41ab-960e-a5d28171ef12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf8b8b6fda84cc88dc6212216680d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:53Z,use_quota=True,user_id='1ebab2c0238b45ac97a200cd4b92a440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac77ce35-a109-43de-a2a9-f47f68c432f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac77ce35-a109-43de-a2a9-f47f68c432f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:53 devstack sudo[109087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0505d16f-18ac-449c-b844-b97205e68be8
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1663a371-2d07-4b6b-a9cd-915e33b12fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:53 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1663a371-2d07-4b6b-a9cd-915e33b12fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed36d56c-3707-41ab-960e-a5d28171ef12', 'volume_name': 'volume-ed36d56c-3707-41ab-960e-a5d28171ef12', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11f8601-702d-4359-9783-57a066ed9ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11f8601-702d-4359-9783-57a066ed9ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6445b931-5382-44ea-8d8f-8613b5a1671d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:53 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Volume ed36d56c-3707-41ab-960e-a5d28171ef12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed36d56c-3707-41ab-960e-a5d28171ef12', 'volume_size': 1}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1516201201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed36d56c-3707-41ab-960e-a5d28171ef12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf8b8b6fda84cc88dc6212216680d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:53Z,use_quota=True,user_id='1ebab2c0238b45ac97a200cd4b92a440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Creating volume ed36d56c-3707-41ab-960e-a5d28171ef12 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:53 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:53 devstack sudo[109089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 1073741824
Aug 04 09:37:53 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:53 devstack sudo[109094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:53 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:53 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0505d16f-18ac-449c-b844-b97205e68be8" returned: 0 in 0.461s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0505d16f-18ac-449c-b844-b97205e68be8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:53 devstack sudo[109105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0505d16f-18ac-449c-b844-b97205e68be8
Aug 04 09:37:53 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:53 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.319s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:53 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Deleted volume successfully.
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-94b9350a-5b35-4282-877a-ef990c690c56 tempest-VolumeAndVolumeTypeFromImageTest-1990220935 None] Lock "cinder-dfbbbb07-fd72-44ab-bfb9-a65ba5435a6f-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:53 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 1073741824" returned: 0 in 0.550s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:53 devstack sudo[109111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12
Aug 04 09:37:53 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:53 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0505d16f-18ac-449c-b844-b97205e68be8" returned: 0 in 0.321s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-quobyte-0505d16f-18ac-449c-b844-b97205e68be8" released by "delete_volume" :: held 0.843s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Created reservations ['6a6de870-ec25-4058-bf80-b1f30b636e97', 'ac2512ea-a9c8-4a18-ac13-bfe3f2a52233', '70ab868e-f534-42ef-bcdf-32ba28d9f217', '6b2a7f8b-ba01-4c54-8e0f-5d1b0b9f01dd'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:54 devstack sudo[109114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:54 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:54 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12" returned: 0 in 0.337s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6445b931-5382-44ea-8d8f-8613b5a1671d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed36d56c-3707-41ab-960e-a5d28171ef12', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fe44c2-af7a-45fb-b643-72d3ac0dbe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "cinder-e9e26577-b59e-4972-b9be-3bc84286187f-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:54 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Volume volume-ed36d56c-3707-41ab-960e-a5d28171ef12 (ed36d56c-3707-41ab-960e-a5d28171ef12): created successfully
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fe44c2-af7a-45fb-b643-72d3ac0dbe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Flow 'volume_create_manager' (9352932a-2b60-4df7-afd4-a356685329aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-e9e26577-b59e-4972-b9be-3bc84286187f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:54 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d85c80d6-77bf-40a8-b1d2-a58799c7ee24 tempest-VolumeDependencyTests-200105239 None] Created volume successfully.
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "cinder-quobyte-e9e26577-b59e-4972-b9be-3bc84286187f" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-quobyte-e9e26577-b59e-4972-b9be-3bc84286187f" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afdc617-ce63-49c0-8e21-c10d59b00594]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9e26577-b59e-4972-b9be-3bc84286187f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:54 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:54 devstack sudo[109116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9e26577-b59e-4972-b9be-3bc84286187f
Aug 04 09:37:54 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.380s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:54 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Deleted volume successfully.
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-06f4bc51-585a-4353-a325-3a53621c71d3 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-0505d16f-18ac-449c-b844-b97205e68be8-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:54 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9e26577-b59e-4972-b9be-3bc84286187f" returned: 0 in 0.431s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9e26577-b59e-4972-b9be-3bc84286187f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:54 devstack sudo[109122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9e26577-b59e-4972-b9be-3bc84286187f
Aug 04 09:37:54 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:54 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e9e26577-b59e-4972-b9be-3bc84286187f" returned: 0 in 0.262s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-quobyte-e9e26577-b59e-4972-b9be-3bc84286187f" released by "delete_volume" :: held 0.747s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Created reservations ['277c23da-e85b-4216-9832-7c3aa35e47ef', 'b5d37261-f0f9-48d8-b4f6-11171bf7c854', '439de9e2-1429-4e24-8d00-2d832f5ba01c', 'caf04c1d-cf7c-486d-9d55-8ad613e6c85c'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:55 devstack sudo[109125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:37:55 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] Creating offline snapshot b975d2a1-a451-409b-8c64-4da12d552a0a of volume ed36d56c-3707-41ab-960e-a5d28171ef12 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:37:55 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.382s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:37:55 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Deleted volume successfully.
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[849f6540-6175-441e-8b6d-3c949f5b9753]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-40d4c3e6-612b-420b-9053-4eb26f7ba9f6 tempest-CreateVolumesFromSourceVolumeTest-1302647736 None] Lock "cinder-e9e26577-b59e-4972-b9be-3bc84286187f-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:37:55 devstack sudo[109130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12
Aug 04 09:37:55 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:56 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12" returned: 0 in 0.490s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:56 devstack sudo[109135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a 1G
Aug 04 09:37:56 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:56 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a 1G" returned: 0 in 0.613s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed36d56c-3707-41ab-960e-a5d28171ef12 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:56 devstack sudo[109141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed36d56c-3707-41ab-960e-a5d28171ef12 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a
Aug 04 09:37:56 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:57 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed36d56c-3707-41ab-960e-a5d28171ef12 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a" returned: 0 in 0.379s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:57 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a is being set with open permissions: ugo+rw
Aug 04 09:37:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:57 devstack sudo[109146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a
Aug 04 09:37:57 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:57 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a" returned: 0 in 0.319s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:57 devstack sudo[109149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.info
Aug 04 09:37:57 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:57 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.info" returned: 0 in 0.318s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:57 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.info is being set with open permissions: ugo+rw
Aug 04 09:37:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:57 devstack sudo[109152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.info
Aug 04 09:37:57 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:58 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.info" returned: 0 in 0.299s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.602s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:58 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-04e51623-0faf-4604-b8e1-60ad2c9094b8 tempest-VolumeDependencyTests-200105239 None] Create snapshot completed successfully
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (6b2794e1-e18f-4511-a478-4ac85f77548d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d1ef4c-6ff8-4b6a-b025-918abb5432d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d1ef4c-6ff8-4b6a-b025-918abb5432d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282408293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb96048-2d9e-49d0-bfe5-51a2d7e34c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:58Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd103f8-2b80-4d03-b5fa-e674a9f85928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd103f8-2b80-4d03-b5fa-e674a9f85928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add21eed-ecc6-4a3e-a845-030bb8930585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add21eed-ecc6-4a3e-a845-030bb8930585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abb96048-2d9e-49d0-bfe5-51a2d7e34c12', 'volume_name': 'volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17fb576-874b-4898-a769-9ae66c1699de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17fb576-874b-4898-a769-9ae66c1699de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128c6a0d-7931-40c9-b29b-200c6b287f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:58 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Volume abb96048-2d9e-49d0-bfe5-51a2d7e34c12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12', 'volume_size': 1}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282408293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb96048-2d9e-49d0-bfe5-51a2d7e34c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:58Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Creating volume abb96048-2d9e-49d0-bfe5-51a2d7e34c12 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:58 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:58 devstack sudo[109155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12 1073741824
Aug 04 09:37:58 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:58 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12 1073741824" returned: 0 in 0.505s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:58 devstack sudo[109161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12
Aug 04 09:37:58 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:59 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12" returned: 0 in 0.380s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128c6a0d-7931-40c9-b29b-200c6b287f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfae91a-0f77-4409-ad7a-c3d461602c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:59 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Volume volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12 (abb96048-2d9e-49d0-bfe5-51a2d7e34c12): created successfully
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfae91a-0f77-4409-ad7a-c3d461602c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (6b2794e1-e18f-4511-a478-4ac85f77548d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:59 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-bd7642c2-f445-4a89-933a-b18a2719fb61 tempest-ProjectMemberTests-2115972071 None] Created volume successfully.
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Flow 'volume_create_manager' (5ce3877a-6f2a-41e7-90c7-c012b04d192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4eac01-c512-49f8-881f-abc471b5e5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4eac01-c512-49f8-881f-abc471b5e5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1784240971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c23922-0c09-4c50-a846-c1dcc59dea68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf8b8b6fda84cc88dc6212216680d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b975d2a1-a451-409b-8c64-4da12d552a0a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:37:59Z,use_quota=True,user_id='1ebab2c0238b45ac97a200cd4b92a440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f3dbce-948f-431f-af08-34fff4179d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f3dbce-948f-431f-af08-34fff4179d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8948b1dc-5637-4430-8b75-02ed5609db75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8948b1dc-5637-4430-8b75-02ed5609db75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33c23922-0c09-4c50-a846-c1dcc59dea68', 'volume_name': 'volume-33c23922-0c09-4c50-a846-c1dcc59dea68', 'volume_size': 1, 'snapshot_id': 'b975d2a1-a451-409b-8c64-4da12d552a0a'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04c5119-0e57-4c34-9c98-045fdf7407ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04c5119-0e57-4c34-9c98-045fdf7407ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68540232-e52b-45b2-bbfd-552a3e5368c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:59 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Volume 33c23922-0c09-4c50-a846-c1dcc59dea68: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33c23922-0c09-4c50-a846-c1dcc59dea68', 'volume_size': 1, 'snapshot_id': 'b975d2a1-a451-409b-8c64-4da12d552a0a'}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "cinder-quobyte-b975d2a1-a451-409b-8c64-4da12d552a0a-33c23922-0c09-4c50-a846-c1dcc59dea68" by "_create_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-quobyte-b975d2a1-a451-409b-8c64-4da12d552a0a-33c23922-0c09-4c50-a846-c1dcc59dea68" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Creating volume 33c23922-0c09-4c50-a846-c1dcc59dea68 from snapshot b975d2a1-a451-409b-8c64-4da12d552a0a {{(pid=88880) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "cinder-quobyte-33c23922-0c09-4c50-a846-c1dcc59dea68" by "_copy_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-quobyte-33c23922-0c09-4c50-a846-c1dcc59dea68" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] snapshot: b975d2a1-a451-409b-8c64-4da12d552a0a, volume: 33c23922-0c09-4c50-a846-c1dcc59dea68,  {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[01622d07-4560-45bf-9044-82086d5b8da5]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:37:59 devstack sudo[109164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a
Aug 04 09:37:59 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Flow 'volume_create_manager' (ed1e79cb-6994-4a5c-aca6-655462a105fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de377bad-0272-4133-8dac-0fff886dbfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de377bad-0272-4133-8dac-0fff886dbfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528664969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb2d0bb-3c75-4ff9-aec5-25707cb85397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fd313463d44d7ba27abed320a9153e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:00Z,use_quota=True,user_id='a0ba39a0f3e040c3bd614ebb3952defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19302983-0d8d-4a2c-8476-b2f2d0fe49aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19302983-0d8d-4a2c-8476-b2f2d0fe49aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699d3d32-0d72-4a85-bd00-a4ad4531276d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699d3d32-0d72-4a85-bd00-a4ad4531276d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb2d0bb-3c75-4ff9-aec5-25707cb85397', 'volume_name': 'volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff05014d-96c0-4ab4-814a-59b4fbf622fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff05014d-96c0-4ab4-814a-59b4fbf622fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf01501e-3e69-475d-a511-07ba0a26d440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:37:59 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume 5bb2d0bb-3c75-4ff9-aec5-25707cb85397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397', 'volume_size': 1}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:37:59 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a" returned: 0 in 0.422s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed36d56c-3707-41ab-960e-a5d28171ef12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Creating direct copy from snapshot {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f16e03-946e-458d-afea-ecd6412ccb63]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:37:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:00 devstack sudo[109169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12
Aug 04 09:38:00 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:00 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12" returned: 0 in 0.395s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:00 devstack cinder-volume[88880]: DEBUG cinder.utils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Path /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68 not found in is_blk_device check {{(pid=88880) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 04 09:38:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:00 devstack sudo[109176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68
Aug 04 09:38:00 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:05 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68" returned: 0 in 4.660s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cf8ee8-e138-4aad-b8ad-507e497bfb56]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:05 devstack sudo[109190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12
Aug 04 09:38:05 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:05 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12" returned: 0 in 0.516s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:38:05 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Converted 1024.00 MB image at 219.69 MB/s
Aug 04 09:38:05 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68 is being set with open permissions: ugo+rw
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:05 devstack sudo[109196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68
Aug 04 09:38:05 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:05 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68" returned: 0 in 0.247s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-quobyte-33c23922-0c09-4c50-a846-c1dcc59dea68" released by "_copy_volume_from_snapshot" :: held 6.360s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-quobyte-b975d2a1-a451-409b-8c64-4da12d552a0a-33c23922-0c09-4c50-a846-c1dcc59dea68" released by "_create_volume_from_snapshot" :: held 6.394s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.411s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.948s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528664969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb2d0bb-3c75-4ff9-aec5-25707cb85397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fd313463d44d7ba27abed320a9153e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:00Z,use_quota=True,user_id='a0ba39a0f3e040c3bd614ebb3952defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Creating volume 5bb2d0bb-3c75-4ff9-aec5-25707cb85397 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:05 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:05 devstack sudo[109199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397 1073741824
Aug 04 09:38:05 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68540232-e52b-45b2-bbfd-552a3e5368c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c23922-0c09-4c50-a846-c1dcc59dea68', 'volume_size': 1, 'snapshot_id': 'b975d2a1-a451-409b-8c64-4da12d552a0a'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814858c7-dfb0-4f3e-b0b7-bfea6457a6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:05 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Volume volume-33c23922-0c09-4c50-a846-c1dcc59dea68 (33c23922-0c09-4c50-a846-c1dcc59dea68): created successfully
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814858c7-dfb0-4f3e-b0b7-bfea6457a6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Flow 'volume_create_manager' (5ce3877a-6f2a-41e7-90c7-c012b04d192c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:05 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-749074be-b82f-4cc8-b3fa-1784cfa51e11 tempest-VolumeDependencyTests-200105239 None] Created volume successfully.
Aug 04 09:38:06 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397 1073741824" returned: 0 in 0.495s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:06 devstack sudo[109205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397
Aug 04 09:38:06 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:06 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397" returned: 0 in 0.253s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.867s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf01501e-3e69-475d-a511-07ba0a26d440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2b1d0e-39f8-4846-9758-0ef7f48a37c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] Creating offline snapshot ce00f242-2b94-401c-9585-536036e0489e of volume abb96048-2d9e-49d0-bfe5-51a2d7e34c12 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:38:06 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397 (5bb2d0bb-3c75-4ff9-aec5-25707cb85397): created successfully
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2b1d0e-39f8-4846-9758-0ef7f48a37c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Flow 'volume_create_manager' (ed1e79cb-6994-4a5c-aca6-655462a105fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[76111066-ec60-4947-b88b-5ea686250d34]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:06 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-01b99dc7-6f59-4d9b-9bd1-6fd3410c125f tempest-CreateVolumesFromSnapshotTest-46754730 None] Created volume successfully.
Aug 04 09:38:06 devstack sudo[109208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12
Aug 04 09:38:06 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "cinder-b975d2a1-a451-409b-8c64-4da12d552a0a-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-b975d2a1-a451-409b-8c64-4da12d552a0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "cinder-quobyte-ed36d56c-3707-41ab-960e-a5d28171ef12" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:07 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12" returned: 0 in 0.413s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-quobyte-ed36d56c-3707-41ab-960e-a5d28171ef12" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "cinder-quobyte-b975d2a1-a451-409b-8c64-4da12d552a0a" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-quobyte-b975d2a1-a451-409b-8c64-4da12d552a0a" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:07 devstack sudo[109213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e 1G
Aug 04 09:38:07 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Deleting offline snapshot b975d2a1-a451-409b-8c64-4da12d552a0a of volume ed36d56c-3707-41ab-960e-a5d28171ef12 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] snapshot_file for this snap is: volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d77b39-254c-4804-9dc2-e59d7278fdf8]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:07 devstack sudo[109215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a
Aug 04 09:38:07 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:07 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e 1G" returned: 0 in 0.499s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:07 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a" returned: 0 in 0.446s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed36d56c-3707-41ab-960e-a5d28171ef12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:38:07 devstack sudo[109223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e
Aug 04 09:38:07 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f9dce1-030a-4ad7-819b-a021c5fe2ac9]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:07 devstack sudo[109225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12
Aug 04 09:38:07 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:08 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e" returned: 0 in 0.419s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:08 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e is being set with open permissions: ugo+rw
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:08 devstack sudo[109230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e
Aug 04 09:38:08 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:08 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12" returned: 0 in 0.494s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:08 devstack sudo[109235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:08 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:08 devstack sudo[109236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a
Aug 04 09:38:08 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:08 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e" returned: 0 in 0.300s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:08 devstack sudo[109240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.info
Aug 04 09:38:08 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:08 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.312s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:38:08 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a" returned: 0 in 0.368s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:08 devstack sudo[109247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a
Aug 04 09:38:08 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:08 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.info" returned: 0 in 0.272s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:08 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.info is being set with open permissions: ugo+rw
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:08 devstack sudo[109250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.info
Aug 04 09:38:08 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:08 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12.b975d2a1-a451-409b-8c64-4da12d552a0a" returned: 0 in 0.260s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-quobyte-b975d2a1-a451-409b-8c64-4da12d552a0a" released by "_delete_snapshot" :: held 1.700s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-quobyte-ed36d56c-3707-41ab-960e-a5d28171ef12" released by "delete_snapshot" :: held 1.746s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:08 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.info" returned: 0 in 0.295s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.025s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Created reservations ['20ce08b8-a558-4e70-bcd1-c2702a821a71', '516722a0-af01-433c-a366-d96cbef68e0e', 'c21dabe9-770f-4a62-b4ce-cac403977aba', 'a3752f1e-7512-4983-968c-fbf280f91c81'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] Creating offline snapshot 4b8a983f-760e-410a-879f-73026624a720 of volume 5bb2d0bb-3c75-4ff9-aec5-25707cb85397 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:38:08 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b08632c5-221e-4852-8092-4a0ed86742d4 tempest-ProjectMemberTests-2115972071 None] Create snapshot completed successfully
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[3993023a-28fb-4346-a17a-6e807ae49475]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:09 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Delete snapshot completed successfully.
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1e380dbe-358a-4fce-9cdd-d9d7aa630867 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-b975d2a1-a451-409b-8c64-4da12d552a0a-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:09 devstack sudo[109254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397
Aug 04 09:38:09 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "cinder-ed36d56c-3707-41ab-960e-a5d28171ef12-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-ce00f242-2b94-401c-9585-536036e0489e-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-ed36d56c-3707-41ab-960e-a5d28171ef12-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Lock "cinder-ce00f242-2b94-401c-9585-536036e0489e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-abb96048-2d9e-49d0-bfe5-51a2d7e34c12" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-abb96048-2d9e-49d0-bfe5-51a2d7e34c12" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-ce00f242-2b94-401c-9585-536036e0489e" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "cinder-quobyte-ed36d56c-3707-41ab-960e-a5d28171ef12" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-ce00f242-2b94-401c-9585-536036e0489e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Deleting offline snapshot ce00f242-2b94-401c-9585-536036e0489e of volume abb96048-2d9e-49d0-bfe5-51a2d7e34c12 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] snapshot_file for this snap is: volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-quobyte-ed36d56c-3707-41ab-960e-a5d28171ef12" acquired by "delete_volume" :: waited 0.047s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccbaf71-5603-482a-84e9-2ba37919a852]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:09 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[853097d1-85ca-4a2e-931b-77ebec93e616]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397" returned: 0 in 0.492s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:09 devstack sudo[109262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720 1G
Aug 04 09:38:09 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:09 devstack sudo[109260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e
Aug 04 09:38:09 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:09 devstack sudo[109261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12
Aug 04 09:38:09 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:09 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:09 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e" returned: 0 in 0.541s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12" returned: 0 in 0.562s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c437f0-3e4b-49aa-9dc3-26448afa75a8]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:10 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720 1G" returned: 0 in 0.574s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:10 devstack sudo[109277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12
Aug 04 09:38:10 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:10 devstack sudo[109280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720
Aug 04 09:38:10 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:10 devstack sudo[109278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12
Aug 04 09:38:10 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:10 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ed36d56c-3707-41ab-960e-a5d28171ef12" returned: 0 in 0.376s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:10 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720" returned: 0 in 0.366s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:10 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720 is being set with open permissions: ugo+rw
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:10 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-quobyte-ed36d56c-3707-41ab-960e-a5d28171ef12" released by "delete_volume" :: held 1.036s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12" returned: 0 in 0.414s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:10 devstack sudo[109290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720
Aug 04 09:38:10 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:10 devstack sudo[109291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e
Aug 04 09:38:10 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Created reservations ['6133f7d5-1589-4981-88de-e4075871dab6', 'e90fb0b6-c36a-4530-8e02-a2d5bba7bf32', '9b0549cc-3dcb-4538-b795-75080867e8b5', '1cda95a5-8d89-4be1-b3df-1e5dd8f29fe9'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:10 devstack sudo[109294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:10 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:10 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720" returned: 0 in 0.316s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:10 devstack sudo[109300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.info
Aug 04 09:38:10 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:10 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e" returned: 0 in 0.416s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:10 devstack sudo[109303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e
Aug 04 09:38:10 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:10 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.287s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:10 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:10 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Deleted volume successfully.
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9b3d403e-7c22-4d46-abe3-326673102af6 tempest-VolumeDependencyTests-200105239 None] Lock "cinder-ed36d56c-3707-41ab-960e-a5d28171ef12-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:11 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.info" returned: 0 in 0.305s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:11 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.info is being set with open permissions: ugo+rw
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:11 devstack sudo[109307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.info
Aug 04 09:38:11 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:11 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12.ce00f242-2b94-401c-9585-536036e0489e" returned: 0 in 0.273s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-ce00f242-2b94-401c-9585-536036e0489e" released by "_delete_snapshot" :: held 1.826s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-abb96048-2d9e-49d0-bfe5-51a2d7e34c12" released by "delete_snapshot" :: held 1.857s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Created reservations ['e50eb985-6498-4341-a97a-bf8deb329de6', 'd56b9d5b-ba11-4746-96bb-eccc2eb422f4', 'e52d77d3-b596-4c88-b53b-7e7a6cd8bc4c', 'cf5ee0d1-f1ae-47b1-bae5-762d97d034e6'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Delete snapshot completed successfully.
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b28e4731-9668-4ab9-8594-8e919342d4bb tempest-ProjectMemberTests-2115972071 None] Lock "cinder-ce00f242-2b94-401c-9585-536036e0489e-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:11 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.info" returned: 0 in 0.264s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ffae4d6e-e517-4989-9c19-7f8678e155e8 tempest-CreateVolumesFromSnapshotTest-46754730 None] Create snapshot completed successfully
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-abb96048-2d9e-49d0-bfe5-51a2d7e34c12-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-abb96048-2d9e-49d0-bfe5-51a2d7e34c12-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-abb96048-2d9e-49d0-bfe5-51a2d7e34c12" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-abb96048-2d9e-49d0-bfe5-51a2d7e34c12" acquired by "delete_volume" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Acquiring lock "cinder-33c23922-0c09-4c50-a846-c1dcc59dea68-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e85fec-4702-4a6d-8706-d8560da4faf8]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Lock "cinder-33c23922-0c09-4c50-a846-c1dcc59dea68-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Acquiring lock "cinder-quobyte-33c23922-0c09-4c50-a846-c1dcc59dea68" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Lock "cinder-quobyte-33c23922-0c09-4c50-a846-c1dcc59dea68" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddbac9e-813d-457e-b373-2009a01b8c87]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:11 devstack sudo[109311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12
Aug 04 09:38:11 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:11 devstack sudo[109312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68
Aug 04 09:38:11 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:12 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12" returned: 0 in 0.412s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:12 devstack sudo[109318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12
Aug 04 09:38:12 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:12 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68" returned: 0 in 0.461s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:12 devstack sudo[109324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68
Aug 04 09:38:12 devstack sudo[109324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:12 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-abb96048-2d9e-49d0-bfe5-51a2d7e34c12" returned: 0 in 0.296s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-abb96048-2d9e-49d0-bfe5-51a2d7e34c12" released by "delete_volume" :: held 0.816s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Created reservations ['4a537a08-5531-43c2-936a-dea39aa1fe75', 'c691b923-8a4b-4a42-ab77-f2061810cdeb', '9b0b4675-7573-45f8-9666-789d67670bf7', 'a083f3b2-f772-4b92-8005-9935aa9fd2d0'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:12 devstack sudo[109324]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-33c23922-0c09-4c50-a846-c1dcc59dea68" returned: 0 in 0.465s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:12 devstack sudo[109328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:12 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Lock "cinder-quobyte-33c23922-0c09-4c50-a846-c1dcc59dea68" released by "delete_volume" :: held 1.001s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Created reservations ['70582348-d3ec-4bce-8e10-b7f9fd83d9de', 'd74e5515-5d05-4228-8877-30ebd552cbb0', 'd33ed1a8-a35c-4fc7-99d1-94a733735b21', '04c77c81-91eb-4178-b510-bc362cb36d19'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Flow 'volume_create_manager' (d40c5984-c55a-479f-a0cb-3129d0a719cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cbdd16d-46a1-4934-9934-90281f44a723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cbdd16d-46a1-4934-9934-90281f44a723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-597087054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96306fe7-7a8f-499d-a2fc-743bd141d60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fd313463d44d7ba27abed320a9153e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:13Z,use_quota=True,user_id='a0ba39a0f3e040c3bd614ebb3952defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4e777b-334e-43df-a326-6b401ffcd784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4e777b-334e-43df-a326-6b401ffcd784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cf482c-4a7f-4d2a-94d3-03ce310a97c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cf482c-4a7f-4d2a-94d3-03ce310a97c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96306fe7-7a8f-499d-a2fc-743bd141d60b', 'volume_name': 'volume-96306fe7-7a8f-499d-a2fc-743bd141d60b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0ea30b-6e92-4fbd-a85e-fdc1dd445ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0ea30b-6e92-4fbd-a85e-fdc1dd445ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08990390-87a0-4c52-a501-9cc527c7834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:13 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume 96306fe7-7a8f-499d-a2fc-743bd141d60b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96306fe7-7a8f-499d-a2fc-743bd141d60b', 'volume_size': 1}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-597087054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96306fe7-7a8f-499d-a2fc-743bd141d60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fd313463d44d7ba27abed320a9153e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:13Z,use_quota=True,user_id='a0ba39a0f3e040c3bd614ebb3952defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Creating volume 96306fe7-7a8f-499d-a2fc-743bd141d60b {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:13 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-96306fe7-7a8f-499d-a2fc-743bd141d60b 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:13 devstack sudo[109331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-96306fe7-7a8f-499d-a2fc-743bd141d60b 1073741824
Aug 04 09:38:13 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:13 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.494s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Deleted volume successfully.
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b30efc38-dcb7-4cd5-b278-b5c3e7497cb4 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-abb96048-2d9e-49d0-bfe5-51a2d7e34c12-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:13 devstack sudo[109333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:13 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:13 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.436s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Deleted volume successfully.
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-7edcd0f5-c817-4d47-8cad-97733ff8d57a tempest-VolumeDependencyTests-200105239 None] Lock "cinder-33c23922-0c09-4c50-a846-c1dcc59dea68-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (d0e478ca-e07e-4b0b-a9e0-6af2d89a830a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df1e085-82fa-4e82-adb8-fbc99d06ed58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df1e085-82fa-4e82-adb8-fbc99d06ed58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1838228658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41d7be3-0f3e-46ac-94bd-d26ed0469d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:14Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38d4440-f388-4fa0-8ea9-60346b1ede54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38d4440-f388-4fa0-8ea9-60346b1ede54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31f829d-ab45-4ccc-8520-b9ff76467ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:13 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31f829d-ab45-4ccc-8520-b9ff76467ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd41d7be3-0f3e-46ac-94bd-d26ed0469d75', 'volume_name': 'volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cff8715-f946-47f7-aa9a-c1e6d166c903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cff8715-f946-47f7-aa9a-c1e6d166c903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2b8020-5980-4ae0-a26c-8701cd3938f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:13 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Volume d41d7be3-0f3e-46ac-94bd-d26ed0469d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75', 'volume_size': 1}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-96306fe7-7a8f-499d-a2fc-743bd141d60b 1073741824" returned: 0 in 0.897s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Flow 'volume_create_manager' (56990d09-3de4-4bdb-b63d-e21c67ed7386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bff41d-7518-4d01-96ca-173f785071ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-96306fe7-7a8f-499d-a2fc-743bd141d60b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bff41d-7518-4d01-96ca-173f785071ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1952622098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4bdeeb-a93a-44b9-8582-1b46187988b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fd313463d44d7ba27abed320a9153e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:14Z,use_quota=True,user_id='a0ba39a0f3e040c3bd614ebb3952defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:14 devstack sudo[109339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-96306fe7-7a8f-499d-a2fc-743bd141d60b
Aug 04 09:38:14 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ef6afb-ac70-4ef3-863e-d2bbaadf2926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ef6afb-ac70-4ef3-863e-d2bbaadf2926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3a39ca-43b1-4c71-8e66-c5ebc123fa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3a39ca-43b1-4c71-8e66-c5ebc123fa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4bdeeb-a93a-44b9-8582-1b46187988b2', 'volume_name': 'volume-de4bdeeb-a93a-44b9-8582-1b46187988b2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51ff451-2f81-4811-a7ca-c3cdf75d23eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51ff451-2f81-4811-a7ca-c3cdf75d23eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f05068d-49ad-4009-acba-f39f1422160f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:14 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume de4bdeeb-a93a-44b9-8582-1b46187988b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4bdeeb-a93a-44b9-8582-1b46187988b2', 'volume_size': 1}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Flow 'volume_create_manager' (b780c1db-d823-4335-9be9-b3c2710d3c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9ed409-22b1-45a3-82e9-b3c2f40e096c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9ed409-22b1-45a3-82e9-b3c2f40e096c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1367162268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc7d82f-d550-4b96-b80c-aa3d17e55709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fd313463d44d7ba27abed320a9153e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:14Z,use_quota=True,user_id='a0ba39a0f3e040c3bd614ebb3952defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01570f1e-b3c0-42d1-b16b-10c0643bba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01570f1e-b3c0-42d1-b16b-10c0643bba58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc4e6c9-7e85-4449-8ce1-e327876469a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc4e6c9-7e85-4449-8ce1-e327876469a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dc7d82f-d550-4b96-b80c-aa3d17e55709', 'volume_name': 'volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c2a85c-ca6c-4b3a-9f8f-386ff8d2dd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c2a85c-ca6c-4b3a-9f8f-386ff8d2dd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f6f7b7-31a0-4b8e-98a5-f06773e16deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:14 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume 1dc7d82f-d550-4b96-b80c-aa3d17e55709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709', 'volume_size': 1}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:14 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-96306fe7-7a8f-499d-a2fc-743bd141d60b" returned: 0 in 0.351s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1838228658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41d7be3-0f3e-46ac-94bd-d26ed0469d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:14Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Creating volume d41d7be3-0f3e-46ac-94bd-d26ed0469d75 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:14 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08990390-87a0-4c52-a501-9cc527c7834b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96306fe7-7a8f-499d-a2fc-743bd141d60b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3328e19f-b968-41ad-987f-eac2ad92195c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:14 devstack sudo[109342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75 1073741824
Aug 04 09:38:14 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:14 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume volume-96306fe7-7a8f-499d-a2fc-743bd141d60b (96306fe7-7a8f-499d-a2fc-743bd141d60b): created successfully
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3328e19f-b968-41ad-987f-eac2ad92195c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Flow 'volume_create_manager' (d40c5984-c55a-479f-a0cb-3129d0a719cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:14 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-56abd7ec-eab0-4c80-b7b7-187d529bd626 tempest-CreateVolumesFromSnapshotTest-46754730 None] Created volume successfully.
Aug 04 09:38:14 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Flow 'volume_create_manager' (26bf03d8-e871-42bd-a391-916c4f8e66cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb1f6d0-abbd-4886-8e4a-a989d010e3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb1f6d0-abbd-4886-8e4a-a989d010e3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-858463269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bb613e-1c19-46f7-8e5c-7c01da40b30a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fd313463d44d7ba27abed320a9153e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:15Z,use_quota=True,user_id='a0ba39a0f3e040c3bd614ebb3952defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57e392c-a42f-4596-9620-69e467801a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57e392c-a42f-4596-9620-69e467801a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ef95ec-be5b-481c-945f-cd1d70e09143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ef95ec-be5b-481c-945f-cd1d70e09143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08bb613e-1c19-46f7-8e5c-7c01da40b30a', 'volume_name': 'volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d69467-6976-41f6-a1dc-a57dd562b948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d69467-6976-41f6-a1dc-a57dd562b948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a7383b-638f-4a67-a505-6db97ec09e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:15 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume 08bb613e-1c19-46f7-8e5c-7c01da40b30a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a', 'volume_size': 1}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:15 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75 1073741824" returned: 0 in 0.773s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:15 devstack sudo[109348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75
Aug 04 09:38:15 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Flow 'volume_create_manager' (bbc8f980-4e17-410b-8c55-3aade7bfb395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7399b2-710d-4e63-a9c4-a9e008f29d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7399b2-710d-4e63-a9c4-a9e008f29d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-466818639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a3f595-d064-4dc4-ac29-3b93fec30e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fd313463d44d7ba27abed320a9153e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:15Z,use_quota=True,user_id='a0ba39a0f3e040c3bd614ebb3952defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2661adca-36e7-44a6-b964-f0613f5509ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2661adca-36e7-44a6-b964-f0613f5509ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ff9dbc-94e8-4b71-bc85-6738e5cf2669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ff9dbc-94e8-4b71-bc85-6738e5cf2669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a3f595-d064-4dc4-ac29-3b93fec30e3f', 'volume_name': 'volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aac7f4d-dd5f-446a-81b9-44fa88ceccdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aac7f4d-dd5f-446a-81b9-44fa88ceccdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5252a72f-fe85-4d11-aba1-95f662770b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:15 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume 42a3f595-d064-4dc4-ac29-3b93fec30e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f', 'volume_size': 1}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:15 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75" returned: 0 in 0.364s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.439s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1952622098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4bdeeb-a93a-44b9-8582-1b46187988b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fd313463d44d7ba27abed320a9153e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:14Z,use_quota=True,user_id='a0ba39a0f3e040c3bd614ebb3952defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Creating volume de4bdeeb-a93a-44b9-8582-1b46187988b2 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:15 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-de4bdeeb-a93a-44b9-8582-1b46187988b2 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:15 devstack sudo[109351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-de4bdeeb-a93a-44b9-8582-1b46187988b2 1073741824
Aug 04 09:38:15 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2b8020-5980-4ae0-a26c-8701cd3938f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19a30ab-7e6c-4765-b080-dbc4ddff6243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:15 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Volume volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75 (d41d7be3-0f3e-46ac-94bd-d26ed0469d75): created successfully
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19a30ab-7e6c-4765-b080-dbc4ddff6243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:15 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (d0e478ca-e07e-4b0b-a9e0-6af2d89a830a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:15 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-8e27a148-b6ab-4aa2-a65c-d806db7271ef tempest-ProjectMemberTests-2115972071 None] Created volume successfully.
Aug 04 09:38:16 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-de4bdeeb-a93a-44b9-8582-1b46187988b2 1073741824" returned: 0 in 0.523s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-de4bdeeb-a93a-44b9-8582-1b46187988b2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:16 devstack sudo[109357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-de4bdeeb-a93a-44b9-8582-1b46187988b2
Aug 04 09:38:16 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:16 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-de4bdeeb-a93a-44b9-8582-1b46187988b2" returned: 0 in 0.281s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.113s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1367162268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc7d82f-d550-4b96-b80c-aa3d17e55709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fd313463d44d7ba27abed320a9153e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:14Z,use_quota=True,user_id='a0ba39a0f3e040c3bd614ebb3952defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Creating volume 1dc7d82f-d550-4b96-b80c-aa3d17e55709 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:16 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f05068d-49ad-4009-acba-f39f1422160f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4bdeeb-a93a-44b9-8582-1b46187988b2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:16 devstack sudo[109360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709 1073741824
Aug 04 09:38:16 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcc7046-22ee-497e-8e83-ad3d5e5f85b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:16 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume volume-de4bdeeb-a93a-44b9-8582-1b46187988b2 (de4bdeeb-a93a-44b9-8582-1b46187988b2): created successfully
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcc7046-22ee-497e-8e83-ad3d5e5f85b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Flow 'volume_create_manager' (56990d09-3de4-4bdb-b63d-e21c67ed7386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:16 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-45d66a5a-4b16-48f6-bde9-ef1106dcf2b7 tempest-CreateVolumesFromSnapshotTest-46754730 None] Created volume successfully.
Aug 04 09:38:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:17 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709 1073741824" returned: 0 in 0.569s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:17 devstack sudo[109366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709
Aug 04 09:38:17 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:17 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Flow 'volume_create_manager' (cfe9458f-7f2d-4d87-b42c-cdf8b0bff3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27973f2b-e6f6-4419-941b-0f9656836e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709" returned: 0 in 0.298s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.375s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-858463269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bb613e-1c19-46f7-8e5c-7c01da40b30a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fd313463d44d7ba27abed320a9153e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:15Z,use_quota=True,user_id='a0ba39a0f3e040c3bd614ebb3952defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Creating volume 08bb613e-1c19-46f7-8e5c-7c01da40b30a {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:17 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27973f2b-e6f6-4419-941b-0f9656836e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3ccedf-9610-4d92-b488-8990ba860ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512e771f22d1488ba4324c6d7fd9eb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:17Z,use_quota=True,user_id='b9033df6225247adaeb7bfb6ec51b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:17 devstack sudo[109369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a 1073741824
Aug 04 09:38:17 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155f1784-5644-4663-8472-155402f25474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155f1784-5644-4663-8472-155402f25474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a827614-4283-42bc-b3a5-b7e487d2b488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a827614-4283-42bc-b3a5-b7e487d2b488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3ccedf-9610-4d92-b488-8990ba860ea3', 'volume_name': 'volume-4c3ccedf-9610-4d92-b488-8990ba860ea3', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc023fc-1692-421a-9cce-8cf8d87085b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc023fc-1692-421a-9cce-8cf8d87085b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078df965-357a-42fa-9f2e-49124e47defb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:17 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Volume 4c3ccedf-9610-4d92-b488-8990ba860ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3ccedf-9610-4d92-b488-8990ba860ea3', 'volume_size': 1}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f6f7b7-31a0-4b8e-98a5-f06773e16deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbb6844-1838-4e34-b522-64382ffe950b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:17 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709 (1dc7d82f-d550-4b96-b80c-aa3d17e55709): created successfully
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbb6844-1838-4e34-b522-64382ffe950b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Flow 'volume_create_manager' (b780c1db-d823-4335-9be9-b3c2710d3c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:17 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-43c950fb-836d-4158-9ceb-08de19841c5c tempest-CreateVolumesFromSnapshotTest-46754730 None] Created volume successfully.
Aug 04 09:38:18 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a 1073741824" returned: 0 in 0.626s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:18 devstack sudo[109375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a
Aug 04 09:38:18 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:18 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a" returned: 0 in 0.257s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.901s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-466818639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a3f595-d064-4dc4-ac29-3b93fec30e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fd313463d44d7ba27abed320a9153e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:15Z,use_quota=True,user_id='a0ba39a0f3e040c3bd614ebb3952defd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Creating volume 42a3f595-d064-4dc4-ac29-3b93fec30e3f {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:18 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a7383b-638f-4a67-a505-6db97ec09e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299d8e97-56b7-407b-8674-694213bb632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:18 devstack sudo[109378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f 1073741824
Aug 04 09:38:18 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:18 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a (08bb613e-1c19-46f7-8e5c-7c01da40b30a): created successfully
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299d8e97-56b7-407b-8674-694213bb632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Flow 'volume_create_manager' (26bf03d8-e871-42bd-a391-916c4f8e66cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:18 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-af287003-6b3b-479e-9037-fc2d5f9fb6f6 tempest-CreateVolumesFromSnapshotTest-46754730 None] Created volume successfully.
Aug 04 09:38:18 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f 1073741824" returned: 0 in 0.518s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:18 devstack sudo[109384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f
Aug 04 09:38:18 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:19 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f" returned: 0 in 0.253s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.341s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5252a72f-fe85-4d11-aba1-95f662770b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dccf397-3859-4a8c-a906-ea42e6db58ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] Creating offline snapshot 35c193fa-0590-45fa-98ee-746757a2f1a0 of volume d41d7be3-0f3e-46ac-94bd-d26ed0469d75 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:38:19 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Volume volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f (42a3f595-d064-4dc4-ac29-3b93fec30e3f): created successfully
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dccf397-3859-4a8c-a906-ea42e6db58ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Flow 'volume_create_manager' (bbc8f980-4e17-410b-8c55-3aade7bfb395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c0015c-af9d-4e2c-a0bc-54524718111e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:19 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-30d7e58e-8e89-4262-8283-8a1e99cb0501 tempest-CreateVolumesFromSnapshotTest-46754730 None] Created volume successfully.
Aug 04 09:38:19 devstack sudo[109387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75
Aug 04 09:38:19 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:19 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75" returned: 0 in 0.429s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:19 devstack sudo[109392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0 1G
Aug 04 09:38:19 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-42a3f595-d064-4dc4-ac29-3b93fec30e3f-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-42a3f595-d064-4dc4-ac29-3b93fec30e3f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-quobyte-42a3f595-d064-4dc4-ac29-3b93fec30e3f" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-42a3f595-d064-4dc4-ac29-3b93fec30e3f" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d3fa50-4e66-4e1b-bed0-10459a3fd84a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:20 devstack sudo[109398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f
Aug 04 09:38:20 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:20 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0 1G" returned: 0 in 0.525s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:20 devstack sudo[109400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0
Aug 04 09:38:20 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:20 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f" returned: 0 in 0.418s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:20 devstack sudo[109410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f
Aug 04 09:38:20 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:20 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0" returned: 0 in 0.316s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:20 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0 is being set with open permissions: ugo+rw
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:20 devstack sudo[109412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0
Aug 04 09:38:20 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:20 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-42a3f595-d064-4dc4-ac29-3b93fec30e3f" returned: 0 in 0.273s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-42a3f595-d064-4dc4-ac29-3b93fec30e3f" released by "delete_volume" :: held 0.733s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:20 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0" returned: 0 in 0.267s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Created reservations ['0d4bd27d-3521-495a-b245-99ae582fe489', '260d0540-65d9-4a8e-813a-72068b6fcf96', 'ed16ce95-7fe7-4413-8ef1-8f30dce98ca2', 'deae9986-4208-4bc0-9608-909a02d5a27e'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:20 devstack sudo[109416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.info
Aug 04 09:38:20 devstack sudo[109416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:21 devstack sudo[109418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:21 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-08bb613e-1c19-46f7-8e5c-7c01da40b30a-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:21 devstack sudo[109416]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.info" returned: 0 in 0.319s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:21 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.info is being set with open permissions: ugo+rw
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-08bb613e-1c19-46f7-8e5c-7c01da40b30a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:21 devstack sudo[109421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.info
Aug 04 09:38:21 devstack sudo[109421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-quobyte-08bb613e-1c19-46f7-8e5c-7c01da40b30a" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:21 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-08bb613e-1c19-46f7-8e5c-7c01da40b30a" acquired by "delete_volume" :: waited 0.024s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.352s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:21 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Deleted volume successfully.
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aab8187-a2d5-48c4-9e6b-74cec2d708c2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f2091b82-8429-47f0-8cf9-b8dd9ee7364f tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-42a3f595-d064-4dc4-ac29-3b93fec30e3f-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:21 devstack sudo[109421]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.info" returned: 0 in 0.281s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:21 devstack sudo[109424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a
Aug 04 09:38:21 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.968s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3ccedf-9610-4d92-b488-8990ba860ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512e771f22d1488ba4324c6d7fd9eb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:17Z,use_quota=True,user_id='b9033df6225247adaeb7bfb6ec51b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Creating volume 4c3ccedf-9610-4d92-b488-8990ba860ea3 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:21 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4c3ccedf-9610-4d92-b488-8990ba860ea3 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:21 devstack sudo[109427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4c3ccedf-9610-4d92-b488-8990ba860ea3 1073741824
Aug 04 09:38:21 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:21 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-54da5c94-d8a2-45da-bf76-b28555f93d90 tempest-ProjectMemberTests-2115972071 None] Create snapshot completed successfully
Aug 04 09:38:21 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a" returned: 0 in 0.435s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:21 devstack sudo[109432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a
Aug 04 09:38:21 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:22 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-08bb613e-1c19-46f7-8e5c-7c01da40b30a" returned: 0 in 0.314s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-35c193fa-0590-45fa-98ee-746757a2f1a0-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-08bb613e-1c19-46f7-8e5c-7c01da40b30a" released by "delete_volume" :: held 0.825s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-35c193fa-0590-45fa-98ee-746757a2f1a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-d41d7be3-0f3e-46ac-94bd-d26ed0469d75" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:22 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4c3ccedf-9610-4d92-b488-8990ba860ea3 1073741824" returned: 0 in 0.645s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-d41d7be3-0f3e-46ac-94bd-d26ed0469d75" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-35c193fa-0590-45fa-98ee-746757a2f1a0" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-35c193fa-0590-45fa-98ee-746757a2f1a0" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Deleting offline snapshot 35c193fa-0590-45fa-98ee-746757a2f1a0 of volume d41d7be3-0f3e-46ac-94bd-d26ed0469d75 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] snapshot_file for this snap is: volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4c3ccedf-9610-4d92-b488-8990ba860ea3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4811eaaf-b839-422c-9ed5-5208e1fe8800]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:22 devstack sudo[109439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4c3ccedf-9610-4d92-b488-8990ba860ea3
Aug 04 09:38:22 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Created reservations ['cc84fc62-dfe1-450e-9c4b-cc8c61a49709', 'df8e0f9d-da32-4b6d-a636-5fa55af5e868', '403adbc2-c8f0-4a35-a0fe-ff7b6342a3eb', '67835155-f666-40a6-83fd-ee555e32c628'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:22 devstack sudo[109441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0
Aug 04 09:38:22 devstack sudo[109441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:22 devstack sudo[109443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:22 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:22 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4c3ccedf-9610-4d92-b488-8990ba860ea3" returned: 0 in 0.392s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078df965-357a-42fa-9f2e-49124e47defb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3ccedf-9610-4d92-b488-8990ba860ea3', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7139a0-cc36-4654-b4fa-ddc11ec7732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:22 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Volume volume-4c3ccedf-9610-4d92-b488-8990ba860ea3 (4c3ccedf-9610-4d92-b488-8990ba860ea3): created successfully
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7139a0-cc36-4654-b4fa-ddc11ec7732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Flow 'volume_create_manager' (cfe9458f-7f2d-4d87-b42c-cdf8b0bff3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:22 devstack sudo[109441]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:22 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-3e822ed8-c0b9-40e5-8955-99e6ff0c1c36 tempest-CinderUnicodeTest-2113335536 None] Created volume successfully.
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0" returned: 0 in 0.450s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:38:22 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.338s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:22 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Deleted volume successfully.
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[35af2474-4ed3-48dd-804f-069f891d8127]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26e168b4-b421-496b-a5ef-56a5d5a6d94b tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-08bb613e-1c19-46f7-8e5c-7c01da40b30a-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:22 devstack sudo[109451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75
Aug 04 09:38:22 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:23 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75" returned: 0 in 0.368s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:23 devstack sudo[109456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0
Aug 04 09:38:23 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-1dc7d82f-d550-4b96-b80c-aa3d17e55709-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-1dc7d82f-d550-4b96-b80c-aa3d17e55709-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-quobyte-1dc7d82f-d550-4b96-b80c-aa3d17e55709" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-1dc7d82f-d550-4b96-b80c-aa3d17e55709" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:23 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0" returned: 0 in 0.404s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:23 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d328cd-b9cb-42ff-9f4e-9061e8d6a1fe]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:23 devstack sudo[109462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0
Aug 04 09:38:23 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:23 devstack sudo[109463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709
Aug 04 09:38:23 devstack sudo[109463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:23 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75.35c193fa-0590-45fa-98ee-746757a2f1a0" returned: 0 in 0.315s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-35c193fa-0590-45fa-98ee-746757a2f1a0" released by "_delete_snapshot" :: held 1.761s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-d41d7be3-0f3e-46ac-94bd-d26ed0469d75" released by "delete_snapshot" :: held 1.806s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:24 devstack sudo[109463]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709" returned: 0 in 0.447s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Created reservations ['8a2fb619-10cd-441f-9f0e-6d90bb733396', '7e506a00-3131-40c8-8127-105ac9f4ebef', '2e7bf778-c540-43b3-9a16-16e5d735442b', 'bef9557f-d86e-442e-853a-f97adf7e9054'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:24 devstack sudo[109470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709
Aug 04 09:38:24 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:24 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Delete snapshot completed successfully.
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e163d2bc-224e-464d-85cb-cc9354a39521 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-35c193fa-0590-45fa-98ee-746757a2f1a0-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-d41d7be3-0f3e-46ac-94bd-d26ed0469d75-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-d41d7be3-0f3e-46ac-94bd-d26ed0469d75-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-d41d7be3-0f3e-46ac-94bd-d26ed0469d75" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-d41d7be3-0f3e-46ac-94bd-d26ed0469d75" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:24 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1dc7d82f-d550-4b96-b80c-aa3d17e55709" returned: 0 in 0.460s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aaaa13-89d4-482b-a108-2cbb53190e18]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-1dc7d82f-d550-4b96-b80c-aa3d17e55709" released by "delete_volume" :: held 0.986s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Flow 'volume_create_manager' (a6f377b7-db59-4041-80ad-c60e6e2cc30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae26257-dede-43b2-881e-83ce598e7050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae26257-dede-43b2-881e-83ce598e7050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1003459909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ed9e97-ff7a-4b27-92bf-41637bfc858c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512e771f22d1488ba4324c6d7fd9eb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:25Z,use_quota=True,user_id='b9033df6225247adaeb7bfb6ec51b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc78070-3612-4a77-92a0-d6fcfb4fb526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc78070-3612-4a77-92a0-d6fcfb4fb526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ee72a5-0edb-4cb1-8ba1-0a029659dcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:24 devstack sudo[109473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75
Aug 04 09:38:24 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ee72a5-0edb-4cb1-8ba1-0a029659dcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38ed9e97-ff7a-4b27-92bf-41637bfc858c', 'volume_name': 'volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e45d62e-e202-466d-8e37-1702f62fd19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e45d62e-e202-466d-8e37-1702f62fd19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f860b53d-8170-4951-ade7-400b1b24b129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:24 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Volume 38ed9e97-ff7a-4b27-92bf-41637bfc858c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c', 'volume_size': 1}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1003459909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ed9e97-ff7a-4b27-92bf-41637bfc858c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512e771f22d1488ba4324c6d7fd9eb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:25Z,use_quota=True,user_id='b9033df6225247adaeb7bfb6ec51b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Creating volume 38ed9e97-ff7a-4b27-92bf-41637bfc858c {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:24 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Created reservations ['82daffd4-a325-4262-845d-218b5c67ad4a', '69479378-7db5-4a9f-a472-0894e45787db', 'ce413717-e66a-41fc-8ed8-8ee528b53976', '044f075f-ce59-4d1b-9fc5-f553c2d161c1'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:24 devstack sudo[109475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c 1073741824
Aug 04 09:38:24 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:24 devstack sudo[109477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:24 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:25 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75" returned: 0 in 0.489s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:25 devstack sudo[109484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75
Aug 04 09:38:25 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:25 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.360s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:25 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Deleted volume successfully.
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-00a7190e-afce-420c-8a2f-67197fa325fd tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-1dc7d82f-d550-4b96-b80c-aa3d17e55709-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:25 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:25 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-d41d7be3-0f3e-46ac-94bd-d26ed0469d75" returned: 0 in 0.318s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c 1073741824" returned: 0 in 0.631s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-d41d7be3-0f3e-46ac-94bd-d26ed0469d75" released by "delete_volume" :: held 0.905s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:25 devstack sudo[109492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c
Aug 04 09:38:25 devstack sudo[109492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Created reservations ['2446f0e0-766e-4d48-ab9b-2ed67b95b240', '6e81e80a-2b54-424c-a5b5-c4ead8953bf8', '0c0900d3-c0e5-40d1-af8b-62a5f32ffdb4', '13066773-fd77-4bb9-95cf-432fc07b38a4'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:25 devstack sudo[109494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:25 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:25 devstack sudo[109492]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c" returned: 0 in 0.299s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f860b53d-8170-4951-ade7-400b1b24b129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72736a1e-7370-4036-9d9f-b3ed920f6830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-de4bdeeb-a93a-44b9-8582-1b46187988b2-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:25 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Volume volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c (38ed9e97-ff7a-4b27-92bf-41637bfc858c): created successfully
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72736a1e-7370-4036-9d9f-b3ed920f6830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Flow 'volume_create_manager' (a6f377b7-db59-4041-80ad-c60e6e2cc30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:25 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:25 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-7522f44f-077e-4a2c-b422-a58858f2737c tempest-CinderUnicodeTest-2113335536 None] Created volume successfully.
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.300s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-de4bdeeb-a93a-44b9-8582-1b46187988b2-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:25 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Deleted volume successfully.
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cadaaf5d-597e-4273-9457-c7647a48bcc1 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-d41d7be3-0f3e-46ac-94bd-d26ed0469d75-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-quobyte-de4bdeeb-a93a-44b9-8582-1b46187988b2" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-de4bdeeb-a93a-44b9-8582-1b46187988b2" acquired by "delete_volume" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f63e9e8-558f-479c-b477-98d2742966ad]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-de4bdeeb-a93a-44b9-8582-1b46187988b2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:26 devstack sudo[109498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-de4bdeeb-a93a-44b9-8582-1b46187988b2
Aug 04 09:38:26 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (de39221c-2097-4587-9c05-451449cf56ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab21bf5d-f42f-4be4-99b5-e063b9e3036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab21bf5d-f42f-4be4-99b5-e063b9e3036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1459736183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e8b941-431d-4e83-b307-d961cbfc4cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:26Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51ebd72-78f8-4d2e-a657-83c80a42a0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51ebd72-78f8-4d2e-a657-83c80a42a0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece18573-7170-44b3-8d1b-5c95c09da9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece18573-7170-44b3-8d1b-5c95c09da9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e8b941-431d-4e83-b307-d961cbfc4cf5', 'volume_name': 'volume-77e8b941-431d-4e83-b307-d961cbfc4cf5', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecb083b-77e7-40d2-bd43-357fb8812bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecb083b-77e7-40d2-bd43-357fb8812bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f28769-fa59-4408-a513-68b44f383018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:26 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Volume 77e8b941-431d-4e83-b307-d961cbfc4cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e8b941-431d-4e83-b307-d961cbfc4cf5', 'volume_size': 1}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1459736183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e8b941-431d-4e83-b307-d961cbfc4cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:26Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Creating volume 77e8b941-431d-4e83-b307-d961cbfc4cf5 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:26 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:26 devstack sudo[109502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5 1073741824
Aug 04 09:38:26 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:26 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-de4bdeeb-a93a-44b9-8582-1b46187988b2" returned: 0 in 0.437s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-de4bdeeb-a93a-44b9-8582-1b46187988b2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:26 devstack sudo[109505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-de4bdeeb-a93a-44b9-8582-1b46187988b2
Aug 04 09:38:26 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:26 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-de4bdeeb-a93a-44b9-8582-1b46187988b2" returned: 0 in 0.379s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-de4bdeeb-a93a-44b9-8582-1b46187988b2" released by "delete_volume" :: held 0.885s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:26 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Created reservations ['30c70a66-a558-4bb1-836c-b53bf0ff8870', '5bcdc058-92a8-47ab-a434-2cba3a40b239', '6963b5bf-4b76-488c-8e34-4ee2801ee1f3', '9e52cc99-10ac-4989-b1ec-dc5efb9cf118'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:27 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5 1073741824" returned: 0 in 0.659s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:27 devstack sudo[109512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:27 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:27 devstack sudo[109514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5
Aug 04 09:38:27 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:27 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.261s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:27 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Deleted volume successfully.
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-14f32dc3-afea-4a78-a0c0-a3da01e53492 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-de4bdeeb-a93a-44b9-8582-1b46187988b2-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:27 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5" returned: 0 in 0.298s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.504s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f28769-fa59-4408-a513-68b44f383018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e8b941-431d-4e83-b307-d961cbfc4cf5', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0bdc1c-db87-4e26-927f-18f78e7cb616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] Creating offline snapshot 44211f67-940a-47bf-9331-ffab288f4e88 of volume 38ed9e97-ff7a-4b27-92bf-41637bfc858c {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:38:27 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Volume volume-77e8b941-431d-4e83-b307-d961cbfc4cf5 (77e8b941-431d-4e83-b307-d961cbfc4cf5): created successfully
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0bdc1c-db87-4e26-927f-18f78e7cb616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (de39221c-2097-4587-9c05-451449cf56ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cee5bf-0ad1-4d63-87b0-c0f64434ed4c]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:27 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ace370af-6ffd-4f3f-acb8-1d617f82c1b3 tempest-ProjectMemberTests-2115972071 None] Created volume successfully.
Aug 04 09:38:27 devstack sudo[109518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c
Aug 04 09:38:27 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:27 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c" returned: 0 in 0.410s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:27 devstack sudo[109525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88 1G
Aug 04 09:38:27 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-96306fe7-7a8f-499d-a2fc-743bd141d60b-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-96306fe7-7a8f-499d-a2fc-743bd141d60b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-quobyte-96306fe7-7a8f-499d-a2fc-743bd141d60b" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-96306fe7-7a8f-499d-a2fc-743bd141d60b" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8801a0-b429-4ff5-b191-ba37bfb44dc0]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-96306fe7-7a8f-499d-a2fc-743bd141d60b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:28 devstack sudo[109530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-96306fe7-7a8f-499d-a2fc-743bd141d60b
Aug 04 09:38:28 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:28 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88 1G" returned: 0 in 0.502s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:28 devstack sudo[109533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88
Aug 04 09:38:28 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:28 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-96306fe7-7a8f-499d-a2fc-743bd141d60b" returned: 0 in 0.470s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-96306fe7-7a8f-499d-a2fc-743bd141d60b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:28 devstack sudo[109538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-96306fe7-7a8f-499d-a2fc-743bd141d60b
Aug 04 09:38:28 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:28 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88" returned: 0 in 0.425s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:28 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88 is being set with open permissions: ugo+rw
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:28 devstack sudo[109543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88
Aug 04 09:38:28 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:28 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-96306fe7-7a8f-499d-a2fc-743bd141d60b" returned: 0 in 0.297s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:28 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-96306fe7-7a8f-499d-a2fc-743bd141d60b" released by "delete_volume" :: held 0.812s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Created reservations ['27372174-8ff4-49b8-a560-3b7314779b7b', '6513c2e0-8329-4cc5-8b4f-1120a3903c00', 'fdcfaa3b-3c73-4b4a-a578-50a20e4bacf6', 'bf63df49-7dcc-4341-b1c1-a8942e4f2210'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:29 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88" returned: 0 in 0.282s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:29 devstack sudo[109547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:29 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:29 devstack sudo[109549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.info
Aug 04 09:38:29 devstack sudo[109549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-4b8a983f-760e-410a-879f-73026624a720-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-4b8a983f-760e-410a-879f-73026624a720-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-quobyte-5bb2d0bb-3c75-4ff9-aec5-25707cb85397" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-5bb2d0bb-3c75-4ff9-aec5-25707cb85397" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-quobyte-4b8a983f-760e-410a-879f-73026624a720" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-4b8a983f-760e-410a-879f-73026624a720" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Deleting offline snapshot 4b8a983f-760e-410a-879f-73026624a720 of volume 5bb2d0bb-3c75-4ff9-aec5-25707cb85397 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] snapshot_file for this snap is: volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ad8666-2abe-4428-9126-6d1c563b5f35]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:29 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.336s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:29 devstack sudo[109549]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:29 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Deleted volume successfully.
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.info" returned: 0 in 0.292s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:29 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.info is being set with open permissions: ugo+rw
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:29 devstack sudo[109554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.info
Aug 04 09:38:29 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a50423de-7a81-43ad-8868-9a54c1e23d1b tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-96306fe7-7a8f-499d-a2fc-743bd141d60b-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:29 devstack sudo[109551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720
Aug 04 09:38:29 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:29 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.info" returned: 0 in 0.285s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.126s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] Creating offline snapshot 89aa298f-0a35-4a4d-8f3a-2541e291ddf0 of volume 77e8b941-431d-4e83-b307-d961cbfc4cf5 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:38:29 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6a24c26b-0dd4-4e5a-addd-6fe88b011e20 tempest-CinderUnicodeTest-2113335536 None] Create snapshot completed successfully
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41350e0-22a8-4dcf-82f4-8f0379921c45]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:29 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720" returned: 0 in 0.525s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[996e09b9-e895-4aa8-b2cc-7072a89ad993]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:30 devstack sudo[109561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5
Aug 04 09:38:30 devstack sudo[109561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "cinder-44211f67-940a-47bf-9331-ffab288f4e88-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:30 devstack sudo[109562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397
Aug 04 09:38:30 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-44211f67-940a-47bf-9331-ffab288f4e88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "cinder-quobyte-38ed9e97-ff7a-4b27-92bf-41637bfc858c" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-quobyte-38ed9e97-ff7a-4b27-92bf-41637bfc858c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "cinder-quobyte-44211f67-940a-47bf-9331-ffab288f4e88" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-quobyte-44211f67-940a-47bf-9331-ffab288f4e88" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Deleting offline snapshot 44211f67-940a-47bf-9331-ffab288f4e88 of volume 38ed9e97-ff7a-4b27-92bf-41637bfc858c {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] snapshot_file for this snap is: volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4947ab5-53cd-4c2c-b733-6c4408b209d5]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:30 devstack sudo[109561]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5" returned: 0 in 0.549s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:30 devstack sudo[109566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88
Aug 04 09:38:30 devstack sudo[109566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:30 devstack sudo[109573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0 1G
Aug 04 09:38:30 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:30 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397" returned: 0 in 0.530s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:30 devstack sudo[109576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720
Aug 04 09:38:30 devstack sudo[109576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:30 devstack sudo[109566]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88" returned: 0 in 0.521s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[db177b95-2171-47d6-9e19-257411c22f2f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:30 devstack sudo[109584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c
Aug 04 09:38:30 devstack sudo[109584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:30 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0 1G" returned: 0 in 0.581s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e8b941-431d-4e83-b307-d961cbfc4cf5 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:31 devstack sudo[109576]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720" returned: 0 in 0.542s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:31 devstack sudo[109590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e8b941-431d-4e83-b307-d961cbfc4cf5 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:31 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:31 devstack sudo[109592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720
Aug 04 09:38:31 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:31 devstack sudo[109584]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c" returned: 0 in 0.481s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:31 devstack sudo[109599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88
Aug 04 09:38:31 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:31 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e8b941-431d-4e83-b307-d961cbfc4cf5 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0" returned: 0 in 0.438s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:31 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0 is being set with open permissions: ugo+rw
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:31 devstack sudo[109603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0
Aug 04 09:38:31 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:31 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397.4b8a983f-760e-410a-879f-73026624a720" returned: 0 in 0.449s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=219,cinder:UPDATE=264,cinder:INSERT=75,cinder:DELETE=32 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=298,cinder:SELECT=200,cinder:DELETE=21,cinder:INSERT=74 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-4b8a983f-760e-410a-879f-73026624a720" released by "_delete_snapshot" :: held 2.265s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-5bb2d0bb-3c75-4ff9-aec5-25707cb85397" released by "delete_snapshot" :: held 2.305s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Created reservations ['658c1519-243c-46d8-99ba-2b61e1043862', '1e89ba99-0db5-4bb7-b5e6-e0af37402646', '9954505d-70fc-4c6b-894e-ac9aea9896a3', 'b787752b-dc14-4443-b4b7-d0a7df3f680c'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:31 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0" returned: 0 in 0.349s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:31 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Delete snapshot completed successfully.
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-0790c2e9-0e63-4250-af4e-440221a325c2 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-4b8a983f-760e-410a-879f-73026624a720-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:31 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88" returned: 0 in 0.540s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:31 devstack sudo[109609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.info
Aug 04 09:38:31 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:31 devstack sudo[109610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88
Aug 04 09:38:31 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:32 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.info" returned: 0 in 0.334s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:32 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.info is being set with open permissions: ugo+rw
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:32 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c.44211f67-940a-47bf-9331-ffab288f4e88" returned: 0 in 0.338s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:32 devstack sudo[109615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.info
Aug 04 09:38:32 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-quobyte-44211f67-940a-47bf-9331-ffab288f4e88" released by "_delete_snapshot" :: held 2.041s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-quobyte-38ed9e97-ff7a-4b27-92bf-41637bfc858c" released by "delete_snapshot" :: held 2.086s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Created reservations ['604f070a-3d8f-462d-922b-aeb1c61fc1cd', 'bbd1e074-7c09-4e7e-a080-eee9ca8769c2', '4f99c770-91fe-4b73-b8f3-75b1d265ea24', '84aa2b91-ae18-4e8b-a2dc-5d927c27e7a2'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-5bb2d0bb-3c75-4ff9-aec5-25707cb85397-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:32 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Delete snapshot completed successfully.
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-5bb2d0bb-3c75-4ff9-aec5-25707cb85397-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-07bc0348-a1d8-4683-8891-65e45d81e8ae tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-44211f67-940a-47bf-9331-ffab288f4e88-delete_snapshot" released by "delete_snapshot" :: held 2.371s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "cinder-quobyte-5bb2d0bb-3c75-4ff9-aec5-25707cb85397" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-5bb2d0bb-3c75-4ff9-aec5-25707cb85397" acquired by "delete_volume" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:32 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.info" returned: 0 in 0.493s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.890s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e025d4-2e6d-419a-bca6-16e1404d210b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:32 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a8b28ee5-deda-4b2b-8fed-98f81712035c tempest-ProjectMemberTests-2115972071 None] Create snapshot completed successfully
Aug 04 09:38:32 devstack sudo[109618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397
Aug 04 09:38:32 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-89aa298f-0a35-4a4d-8f3a-2541e291ddf0-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Lock "cinder-89aa298f-0a35-4a4d-8f3a-2541e291ddf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-77e8b941-431d-4e83-b307-d961cbfc4cf5" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-77e8b941-431d-4e83-b307-d961cbfc4cf5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-89aa298f-0a35-4a4d-8f3a-2541e291ddf0" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-89aa298f-0a35-4a4d-8f3a-2541e291ddf0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Deleting offline snapshot 89aa298f-0a35-4a4d-8f3a-2541e291ddf0 of volume 77e8b941-431d-4e83-b307-d961cbfc4cf5 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] snapshot_file for this snap is: volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad013c20-3013-46e1-955e-8c23336a0b40]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:33 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397" returned: 0 in 0.497s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:33 devstack sudo[109625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397
Aug 04 09:38:33 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:33 devstack sudo[109622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0
Aug 04 09:38:33 devstack sudo[109622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "cinder-38ed9e97-ff7a-4b27-92bf-41637bfc858c-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:33 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5bb2d0bb-3c75-4ff9-aec5-25707cb85397" returned: 0 in 0.337s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-quobyte-5bb2d0bb-3c75-4ff9-aec5-25707cb85397" released by "delete_volume" :: held 0.937s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-38ed9e97-ff7a-4b27-92bf-41637bfc858c-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:33 devstack sudo[109622]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0" returned: 0 in 0.535s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77e8b941-431d-4e83-b307-d961cbfc4cf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "cinder-quobyte-38ed9e97-ff7a-4b27-92bf-41637bfc858c" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dd1c2c-1d31-4b4d-b36e-e4012d56ee97]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Created reservations ['0f25aee6-107e-4e6a-8b86-e80838642868', '134af3cb-06b7-438d-b0e0-1e623fcb382e', 'a45c3d4f-4167-4715-94d8-a9a01d726338', '12c70d3f-f108-445b-a39d-7f9085fe29fe'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-quobyte-38ed9e97-ff7a-4b27-92bf-41637bfc858c" acquired by "delete_volume" :: waited 0.051s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ed7b0c-a2c8-424d-9183-64e48eff227c]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:33 devstack sudo[109632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5
Aug 04 09:38:33 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:33 devstack sudo[109635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:33 devstack sudo[109635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:33 devstack sudo[109633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c
Aug 04 09:38:33 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:34 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5" returned: 0 in 0.487s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:34 devstack sudo[109641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0
Aug 04 09:38:34 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:34 devstack sudo[109635]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.393s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:34 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Deleted volume successfully.
Aug 04 09:38:34 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c" returned: 0 in 0.575s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b1ca9d4c-d74a-4d4f-b695-7cedbc111333 tempest-CreateVolumesFromSnapshotTest-46754730 None] Lock "cinder-5bb2d0bb-3c75-4ff9-aec5-25707cb85397-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:34 devstack sudo[109647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c
Aug 04 09:38:34 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:34 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0" returned: 0 in 0.561s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:34 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-38ed9e97-ff7a-4b27-92bf-41637bfc858c" returned: 0 in 0.395s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:34 devstack sudo[109654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0
Aug 04 09:38:34 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-quobyte-38ed9e97-ff7a-4b27-92bf-41637bfc858c" released by "delete_volume" :: held 1.083s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Created reservations ['67e9aa5f-e846-4373-994f-b5feedda0736', '5db3755c-ea92-4116-8c97-d443304d75c8', '5310456f-24fe-43cd-8a65-8ca7e28e6dde', '2c54a9a6-ae8f-4e99-803d-a983089dcdba'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:35 devstack sudo[109656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:35 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:35 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5.89aa298f-0a35-4a4d-8f3a-2541e291ddf0" returned: 0 in 0.333s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-89aa298f-0a35-4a4d-8f3a-2541e291ddf0" released by "_delete_snapshot" :: held 2.054s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-77e8b941-431d-4e83-b307-d961cbfc4cf5" released by "delete_snapshot" :: held 2.086s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Created reservations ['f13476ba-86a7-4bf8-8d34-29518022a758', 'd6c15212-1e1d-4df6-8ae6-494abe281b53', '04fbe0df-6432-4109-b056-e6b707d4554e', '2b69a8e2-862b-4bbc-8d6b-cabfb56f0b37'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:35 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Delete snapshot completed successfully.
Aug 04 09:38:35 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-26b71dec-5460-4064-8419-cc3f19e8954f tempest-ProjectMemberTests-2115972071 None] Lock "cinder-89aa298f-0a35-4a4d-8f3a-2541e291ddf0-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.312s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:35 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Deleted volume successfully.
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-63ba810e-a9aa-4852-83d9-07f18471f5a4 tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-38ed9e97-ff7a-4b27-92bf-41637bfc858c-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "cinder-4c3ccedf-9610-4d92-b488-8990ba860ea3-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-4c3ccedf-9610-4d92-b488-8990ba860ea3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Flow 'volume_create_manager' (5ba24bcd-2103-4827-b2da-2a9a318f6d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64e6b5e-5ad5-47fe-aeab-7e87b498b717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "cinder-quobyte-4c3ccedf-9610-4d92-b488-8990ba860ea3" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64e6b5e-5ad5-47fe-aeab-7e87b498b717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1707151169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6ce97d-21d8-455e-9ced-99bd85c6e44e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bac37e523d548fcafdb18c46489d3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:36Z,use_quota=True,user_id='af60537fd49643dd9ffcd0b1c0299364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44509a5-b0f6-4151-830a-6f3af92514d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44509a5-b0f6-4151-830a-6f3af92514d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:35 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c2be5c-7239-4476-a7dd-d43870649c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c2be5c-7239-4476-a7dd-d43870649c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6ce97d-21d8-455e-9ced-99bd85c6e44e', 'volume_name': 'volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94573eb9-e8d4-4e8a-85dd-1d5b0529ed50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94573eb9-e8d4-4e8a-85dd-1d5b0529ed50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19d2bc1-b23b-402d-84f3-5a1a774d6459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:36 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Volume 8b6ce97d-21d8-455e-9ced-99bd85c6e44e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e', 'volume_size': 1}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1707151169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6ce97d-21d8-455e-9ced-99bd85c6e44e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bac37e523d548fcafdb18c46489d3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:36Z,use_quota=True,user_id='af60537fd49643dd9ffcd0b1c0299364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Creating volume 8b6ce97d-21d8-455e-9ced-99bd85c6e44e {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:36 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-quobyte-4c3ccedf-9610-4d92-b488-8990ba860ea3" acquired by "delete_volume" :: waited 0.080s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:36 devstack sudo[109660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e 1073741824
Aug 04 09:38:36 devstack sudo[109660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccc8725-1faf-4ea2-9cb0-3099ac956a91]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4c3ccedf-9610-4d92-b488-8990ba860ea3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:36 devstack sudo[109662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4c3ccedf-9610-4d92-b488-8990ba860ea3
Aug 04 09:38:36 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-77e8b941-431d-4e83-b307-d961cbfc4cf5-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-77e8b941-431d-4e83-b307-d961cbfc4cf5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-77e8b941-431d-4e83-b307-d961cbfc4cf5" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-77e8b941-431d-4e83-b307-d961cbfc4cf5" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e670d6-6595-493b-93e9-3cd77d20b70e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:36 devstack sudo[109660]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e 1073741824" returned: 0 in 0.526s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:36 devstack sudo[109668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5
Aug 04 09:38:36 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:36 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4c3ccedf-9610-4d92-b488-8990ba860ea3" returned: 0 in 0.495s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4c3ccedf-9610-4d92-b488-8990ba860ea3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:36 devstack sudo[109674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4c3ccedf-9610-4d92-b488-8990ba860ea3
Aug 04 09:38:36 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:36 devstack sudo[109676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e
Aug 04 09:38:36 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:36 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5" returned: 0 in 0.463s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:36 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-4c3ccedf-9610-4d92-b488-8990ba860ea3" returned: 0 in 0.320s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:36 devstack sudo[109683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5
Aug 04 09:38:36 devstack sudo[109683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-quobyte-4c3ccedf-9610-4d92-b488-8990ba860ea3" released by "delete_volume" :: held 0.870s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:36 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" returned: 0 in 0.306s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19d2bc1-b23b-402d-84f3-5a1a774d6459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c59901-5607-4b80-ba15-db18a394c488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:36 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Volume volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e (8b6ce97d-21d8-455e-9ced-99bd85c6e44e): created successfully
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c59901-5607-4b80-ba15-db18a394c488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:36 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Flow 'volume_create_manager' (5ba24bcd-2103-4827-b2da-2a9a318f6d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1ce16dac-1be0-4d98-b5db-554f87ac17c1 tempest-SnapshotDependencyTests-51626884 None] Created volume successfully.
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Created reservations ['ad2c2f48-08b9-43a1-834e-898b9ac65a7d', '047b1ab8-f693-46d4-9daa-838c67b63b1b', 'c9f8c96a-594f-4f0f-a896-a2a4e0919cc9', '8fc792ff-6113-4e86-995d-4773eb217a3e'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:37 devstack sudo[109685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:37 devstack sudo[109685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:37 devstack sudo[109683]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-77e8b941-431d-4e83-b307-d961cbfc4cf5" returned: 0 in 0.294s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-77e8b941-431d-4e83-b307-d961cbfc4cf5" released by "delete_volume" :: held 0.838s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Created reservations ['49392244-9414-4dcc-99e9-6b03d0c0dc55', '24c256f7-ca6f-459e-a919-907cf083d96f', '1026ffb3-7ea3-43c7-9d42-b68e46d2e2b0', '60fe3aea-34fb-4ac2-9e9a-1e6b5c870d71'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:37 devstack sudo[109685]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.268s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:37 devstack sudo[109689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:37 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Deleted volume successfully.
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-83ac38e5-d36d-4ef9-a060-9f204379b281 tempest-CinderUnicodeTest-2113335536 None] Lock "cinder-4c3ccedf-9610-4d92-b488-8990ba860ea3-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:37 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.293s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Deleted volume successfully.
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-bf15bb02-df19-44c3-8059-60f698a45f54 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-77e8b941-431d-4e83-b307-d961cbfc4cf5-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (fe59289e-fa01-4042-bc2f-bdf2f53d985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0901298f-e8db-43c8-82d1-2d7b92cb9f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0901298f-e8db-43c8-82d1-2d7b92cb9f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-507857648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c022b9c-200f-48b8-ba83-13da1d88751a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:38Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c83ed1c-44ef-4d1d-b4dc-f929311ef979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c83ed1c-44ef-4d1d-b4dc-f929311ef979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a0c031-ad21-451d-8476-766e062f1cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a0c031-ad21-451d-8476-766e062f1cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c022b9c-200f-48b8-ba83-13da1d88751a', 'volume_name': 'volume-5c022b9c-200f-48b8-ba83-13da1d88751a', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e62c79-6c3e-4f0e-8f73-cd06ca5d5748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e62c79-6c3e-4f0e-8f73-cd06ca5d5748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2107e5-0d5f-49a8-ad4b-ada62b8a8292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:37 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Volume 5c022b9c-200f-48b8-ba83-13da1d88751a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c022b9c-200f-48b8-ba83-13da1d88751a', 'volume_size': 1}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-507857648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c022b9c-200f-48b8-ba83-13da1d88751a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:38Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Creating volume 5c022b9c-200f-48b8-ba83-13da1d88751a {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:37 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:38 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:38 devstack sudo[109692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a 1073741824
Aug 04 09:38:38 devstack sudo[109692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:38 devstack sudo[109692]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a 1073741824" returned: 0 in 0.555s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:38 devstack sudo[109698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a
Aug 04 09:38:38 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-35c92e78-bd56-41a2-8452-b91fd7ffea21 tempest-ProjectAdminTests-1509366674 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576637268066, 'free_capacity_gb': 1775.7576637268066, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88880) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 04 09:38:38 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a" returned: 0 in 0.288s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.552s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] Creating offline snapshot cdf9efbc-ad3f-4247-9b8c-602d32144130 of volume 8b6ce97d-21d8-455e-9ced-99bd85c6e44e {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2107e5-0d5f-49a8-ad4b-ada62b8a8292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c022b9c-200f-48b8-ba83-13da1d88751a', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fa694c-1dc3-4f26-8be8-ab90b37216fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[87da487f-bbb8-4d2f-ba62-3eb42480ea7e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:38 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Volume volume-5c022b9c-200f-48b8-ba83-13da1d88751a (5c022b9c-200f-48b8-ba83-13da1d88751a): created successfully
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fa694c-1dc3-4f26-8be8-ab90b37216fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:38 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (fe59289e-fa01-4042-bc2f-bdf2f53d985b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:39 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-bc8e1cb9-7d94-4f1b-849e-38de3e6b9ca5 tempest-ProjectMemberTests-2115972071 None] Created volume successfully.
Aug 04 09:38:39 devstack sudo[109701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e
Aug 04 09:38:39 devstack sudo[109701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:39 devstack sudo[109701]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" returned: 0 in 0.452s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:39 devstack sudo[109706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130 1G
Aug 04 09:38:39 devstack sudo[109706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:39 devstack sudo[109706]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130 1G" returned: 0 in 0.585s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:39 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:40 devstack sudo[109712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130
Aug 04 09:38:40 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:40 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130" returned: 0 in 0.408s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:40 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130 is being set with open permissions: ugo+rw
Aug 04 09:38:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:40 devstack sudo[109718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130
Aug 04 09:38:40 devstack sudo[109718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:40 devstack sudo[109718]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130" returned: 0 in 0.307s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:40 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:40 devstack sudo[109721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.info
Aug 04 09:38:40 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:41 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.info" returned: 0 in 0.257s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:41 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.info is being set with open permissions: ugo+rw
Aug 04 09:38:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:41 devstack sudo[109724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.info
Aug 04 09:38:41 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:41 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.info" returned: 0 in 0.249s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.067s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:41 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] Creating offline snapshot 088db327-b573-4431-b222-d0b7d5a7965e of volume 5c022b9c-200f-48b8-ba83-13da1d88751a {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:38:41 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[396d07bf-d086-41d6-b670-467acd0680a5]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:41 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-5565e2c9-1a0c-4fc1-aced-3758b529617c tempest-SnapshotDependencyTests-51626884 None] Create snapshot completed successfully
Aug 04 09:38:41 devstack sudo[109727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a
Aug 04 09:38:41 devstack sudo[109727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:41 devstack sudo[109727]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a" returned: 0 in 0.453s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:41 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:41 devstack sudo[109733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e 1G
Aug 04 09:38:41 devstack sudo[109733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Flow 'volume_create_manager' (ba50a6b4-7318-47a2-a415-ab571333381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea447ed0-8872-490c-9b87-ad7f277d0c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:42 devstack sudo[109733]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea447ed0-8872-490c-9b87-ad7f277d0c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d93525-0c68-44fe-9a24-a2ad1e76dde9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bac37e523d548fcafdb18c46489d3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cdf9efbc-ad3f-4247-9b8c-602d32144130,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:42Z,use_quota=True,user_id='af60537fd49643dd9ffcd0b1c0299364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee154462-8bec-4266-b106-18e9541d6d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee154462-8bec-4266-b106-18e9541d6d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c479be6-5f98-463d-947d-0bfd62990a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c479be6-5f98-463d-947d-0bfd62990a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7d93525-0c68-44fe-9a24-a2ad1e76dde9', 'volume_name': 'volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9', 'volume_size': 1, 'snapshot_id': 'cdf9efbc-ad3f-4247-9b8c-602d32144130'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4085e166-b6a7-4ad7-afe0-aab1c62d9d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4085e166-b6a7-4ad7-afe0-aab1c62d9d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ccf848-a57a-44b3-bca6-3489dc01933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:42 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Volume e7d93525-0c68-44fe-9a24-a2ad1e76dde9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9', 'volume_size': 1, 'snapshot_id': 'cdf9efbc-ad3f-4247-9b8c-602d32144130'}
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e 1G" returned: 0 in 0.600s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c022b9c-200f-48b8-ba83-13da1d88751a -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:42 devstack sudo[109739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c022b9c-200f-48b8-ba83-13da1d88751a -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e
Aug 04 09:38:42 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:42 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c022b9c-200f-48b8-ba83-13da1d88751a -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e" returned: 0 in 0.348s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:42 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e is being set with open permissions: ugo+rw
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:42 devstack sudo[109744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e
Aug 04 09:38:42 devstack sudo[109744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:42 devstack sudo[109744]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:42 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e" returned: 0 in 0.259s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:43 devstack sudo[109747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.info
Aug 04 09:38:43 devstack sudo[109747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:43 devstack sudo[109747]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.info" returned: 0 in 0.324s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:43 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.info is being set with open permissions: ugo+rw
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:43 devstack sudo[109750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.info
Aug 04 09:38:43 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Flow 'volume_create_manager' (cf291c8f-e349-4719-a40c-f1449214b57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f6517a-1752-47d8-9b4e-182a63959985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f6517a-1752-47d8-9b4e-182a63959985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1637637531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db1d24b-f0a2-4f3e-94d9-fa030d080bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7267c934064744ea8ab73ea3d38bda31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:43Z,use_quota=True,user_id='ab14d56468b1434b9da4f2a6c0024d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6461e5-f077-4195-946e-9152259d7909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6461e5-f077-4195-946e-9152259d7909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c130a1-7eda-407d-a7d3-b5d1dc6148b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c130a1-7eda-407d-a7d3-b5d1dc6148b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2db1d24b-f0a2-4f3e-94d9-fa030d080bcc', 'volume_name': 'volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eea5554-c575-4ba9-ad0c-9626a8455441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eea5554-c575-4ba9-ad0c-9626a8455441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be675f18-9c61-4945-bc4b-4365f2d7a48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:43 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Volume 2db1d24b-f0a2-4f3e-94d9-fa030d080bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc', 'volume_size': 1}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:43 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.info" returned: 0 in 0.249s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.213s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "cinder-quobyte-cdf9efbc-ad3f-4247-9b8c-602d32144130-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" by "_create_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-quobyte-cdf9efbc-ad3f-4247-9b8c-602d32144130-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Creating volume e7d93525-0c68-44fe-9a24-a2ad1e76dde9 from snapshot cdf9efbc-ad3f-4247-9b8c-602d32144130 {{(pid=88880) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "cinder-quobyte-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" by "_copy_volume_from_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:43 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ddcf5b55-22c1-45f3-a227-b028bfbeb871 tempest-ProjectMemberTests-2115972071 None] Create snapshot completed successfully
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-quobyte-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] snapshot: cdf9efbc-ad3f-4247-9b8c-602d32144130, volume: e7d93525-0c68-44fe-9a24-a2ad1e76dde9,  {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d8fae3-d844-43c6-b25a-278d2033bde0]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:43 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:43 devstack sudo[109753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130
Aug 04 09:38:43 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:44 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130" returned: 0 in 0.383s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Creating direct copy from snapshot {{(pid=88880) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51332bc-a94f-4015-be8c-7a206cbf299c]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:44 devstack sudo[109758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e
Aug 04 09:38:44 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-088db327-b573-4431-b222-d0b7d5a7965e-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-088db327-b573-4431-b222-d0b7d5a7965e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-5c022b9c-200f-48b8-ba83-13da1d88751a" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-5c022b9c-200f-48b8-ba83-13da1d88751a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-088db327-b573-4431-b222-d0b7d5a7965e" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-088db327-b573-4431-b222-d0b7d5a7965e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Deleting offline snapshot 088db327-b573-4431-b222-d0b7d5a7965e of volume 5c022b9c-200f-48b8-ba83-13da1d88751a {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] snapshot_file for this snap is: volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9433afe6-c22c-4b13-bb0f-76ff0b14bfd1]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:44 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" returned: 0 in 0.398s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.utils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Path /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9 not found in is_blk_device check {{(pid=88880) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:44 devstack sudo[109764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9
Aug 04 09:38:44 devstack sudo[109764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:44 devstack sudo[109763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e
Aug 04 09:38:44 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:44 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e" returned: 0 in 0.388s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c022b9c-200f-48b8-ba83-13da1d88751a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[145a2391-8720-4a21-8dcb-f6fa6f3c5cff]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:44 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:45 devstack sudo[109774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a
Aug 04 09:38:45 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:45 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a" returned: 0 in 0.832s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:45 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:45 devstack sudo[109787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e
Aug 04 09:38:45 devstack sudo[109787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:46 devstack sudo[109787]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e" returned: 0 in 0.663s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:46 devstack sudo[109793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e
Aug 04 09:38:46 devstack sudo[109793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:46 devstack sudo[109793]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:46 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a.088db327-b573-4431-b222-d0b7d5a7965e" returned: 0 in 0.503s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-088db327-b573-4431-b222-d0b7d5a7965e" released by "_delete_snapshot" :: held 2.532s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-5c022b9c-200f-48b8-ba83-13da1d88751a" released by "delete_snapshot" :: held 2.570s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:47 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Created reservations ['b4167dbc-f032-453d-b0ed-247a35aaddce', 'b880d6d7-1e79-43f0-83a5-1c7d8d22b42a', 'df1c4590-9066-452a-8bff-84a53d171d66', 'e1409943-59b8-4800-8082-440373c07e26'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:47 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Delete snapshot completed successfully.
Aug 04 09:38:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-21921e7a-6ab1-436c-908b-ae2f805e7196 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-088db327-b573-4431-b222-d0b7d5a7965e-delete_snapshot" released by "delete_snapshot" :: held 2.871s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-5c022b9c-200f-48b8-ba83-13da1d88751a-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-5c022b9c-200f-48b8-ba83-13da1d88751a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-5c022b9c-200f-48b8-ba83-13da1d88751a" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:47 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-5c022b9c-200f-48b8-ba83-13da1d88751a" acquired by "delete_volume" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:48 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[417ea1af-8d7a-47a4-b7d5-6457406815ee]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:48 devstack sudo[109832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a
Aug 04 09:38:48 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:48 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a" returned: 0 in 0.588s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:48 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:48 devstack sudo[109837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a
Aug 04 09:38:48 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:49 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-5c022b9c-200f-48b8-ba83-13da1d88751a" returned: 0 in 0.542s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:49 devstack sudo[109764]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" returned: 0 in 4.646s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-5c022b9c-200f-48b8-ba83-13da1d88751a" released by "delete_volume" :: held 1.247s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f4c55f-aee9-46f7-b849-f472978355f2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Created reservations ['8ada13e7-0950-4337-80a4-34e933fb0eed', '0cc8cf83-84b1-4ce4-9e1d-d3b0e08e48b2', '6578975b-c2a8-4cfa-aa35-09570adad88d', '5125d06b-a364-46dc-80e0-b246cc9b1956'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:49 devstack sudo[109840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e
Aug 04 09:38:49 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:49 devstack sudo[109842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:49 devstack sudo[109842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:49 devstack sudo[109842]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.242s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:49 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Deleted volume successfully.
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ee36bf55-8123-4ebc-b2ae-9e32b97a6f24 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-5c022b9c-200f-48b8-ba83-13da1d88751a-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:49 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" returned: 0 in 0.542s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.image.image_utils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e, size 1024.00 MB, duration 4.65 sec, destination /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9 {{(pid=88880) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 04 09:38:49 devstack cinder-volume[88880]: INFO cinder.image.image_utils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Converted 1024.00 MB image at 220.36 MB/s
Aug 04 09:38:49 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9 is being set with open permissions: ugo+rw
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:49 devstack sudo[109848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9
Aug 04 09:38:49 devstack sudo[109848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:49 devstack sudo[109848]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" returned: 0 in 0.231s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-quobyte-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" released by "_copy_volume_from_snapshot" :: held 6.299s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-quobyte-cdf9efbc-ad3f-4247-9b8c-602d32144130-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" released by "_create_volume_from_snapshot" :: held 6.336s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.359s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.518s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1637637531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db1d24b-f0a2-4f3e-94d9-fa030d080bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7267c934064744ea8ab73ea3d38bda31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:43Z,use_quota=True,user_id='ab14d56468b1434b9da4f2a6c0024d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Creating volume 2db1d24b-f0a2-4f3e-94d9-fa030d080bcc {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:49 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:49 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:50 devstack sudo[109851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc 1073741824
Aug 04 09:38:50 devstack sudo[109851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ccf848-a57a-44b3-bca6-3489dc01933c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9', 'volume_size': 1, 'snapshot_id': 'cdf9efbc-ad3f-4247-9b8c-602d32144130'}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422b8775-77fb-48c2-a445-687772a5a306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:50 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Volume volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9 (e7d93525-0c68-44fe-9a24-a2ad1e76dde9): created successfully
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422b8775-77fb-48c2-a445-687772a5a306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Flow 'volume_create_manager' (ba50a6b4-7318-47a2-a415-ab571333381c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:50 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b974f13c-4252-4017-afe0-78bc4d0b24fb tempest-SnapshotDependencyTests-51626884 None] Created volume successfully.
Aug 04 09:38:50 devstack sudo[109851]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc 1073741824" returned: 0 in 0.461s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:50 devstack sudo[109858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc
Aug 04 09:38:50 devstack sudo[109858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (63b9a773-ab67-44e0-9daf-20c9a102e131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a93ea4-a308-498b-a6aa-de9d16637ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a93ea4-a308-498b-a6aa-de9d16637ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-132513051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:51Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe372309-aab9-4c03-abb9-cbcced8bce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe372309-aab9-4c03-abb9-cbcced8bce1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4004eac-72cd-4036-b725-cf2f3f89c600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4004eac-72cd-4036-b725-cf2f3f89c600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee', 'volume_name': 'volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b937c9-53d3-4ee5-ade9-5d07c06c2522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b937c9-53d3-4ee5-ade9-5d07c06c2522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e4eaf3-309f-4211-b625-bfbacebf3a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:50 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Volume 9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee', 'volume_size': 1}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:50 devstack sudo[109858]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc" returned: 0 in 0.252s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-132513051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:51Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Creating volume 9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:50 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be675f18-9c61-4945-bc4b-4365f2d7a48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe44246-0c2d-491e-9159-2d09891225e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:50 devstack sudo[109861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee 1073741824
Aug 04 09:38:50 devstack sudo[109861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:50 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Volume volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc (2db1d24b-f0a2-4f3e-94d9-fa030d080bcc): created successfully
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe44246-0c2d-491e-9159-2d09891225e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:50 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Flow 'volume_create_manager' (cf291c8f-e349-4719-a40c-f1449214b57f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:50 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6bf5a1b2-8e55-44ca-9829-9585fddaaf7f tempest-ProjectReaderTests-1609283064 None] Created volume successfully.
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "cinder-cdf9efbc-ad3f-4247-9b8c-602d32144130-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-cdf9efbc-ad3f-4247-9b8c-602d32144130-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "cinder-quobyte-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-quobyte-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "cinder-quobyte-cdf9efbc-ad3f-4247-9b8c-602d32144130" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-quobyte-cdf9efbc-ad3f-4247-9b8c-602d32144130" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Deleting offline snapshot cdf9efbc-ad3f-4247-9b8c-602d32144130 of volume 8b6ce97d-21d8-455e-9ced-99bd85c6e44e {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] snapshot_file for this snap is: volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[942da871-2d12-4551-b0ed-598d6cf4b63d]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:51 devstack sudo[109861]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee 1073741824" returned: 0 in 0.528s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:51 devstack sudo[109868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee
Aug 04 09:38:51 devstack sudo[109868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:51 devstack sudo[109867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130
Aug 04 09:38:51 devstack sudo[109867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:51 devstack sudo[109868]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee" returned: 0 in 0.261s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.293s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e4eaf3-309f-4211-b625-bfbacebf3a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb937a85-fd92-47cf-a8a5-61abb5a3c82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] Creating offline snapshot 243f3081-092f-4277-9680-79c3457200d2 of volume 2db1d24b-f0a2-4f3e-94d9-fa030d080bcc {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:38:51 devstack sudo[109867]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130" returned: 0 in 0.380s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6927ff-4386-4608-ab7c-7a99b9892869]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:51 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Volume volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee (9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee): created successfully
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb937a85-fd92-47cf-a8a5-61abb5a3c82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (63b9a773-ab67-44e0-9daf-20c9a102e131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed02b31-8d14-42ba-a4a2-b1716691447a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:51 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:51 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e39b449a-bfa3-47e9-a6f9-0e29f869b999 tempest-ProjectMemberTests-2115972071 None] Created volume successfully.
Aug 04 09:38:51 devstack sudo[109875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc
Aug 04 09:38:51 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:51 devstack sudo[109876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e
Aug 04 09:38:51 devstack sudo[109876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:52 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc" returned: 0 in 0.355s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:52 devstack sudo[109876]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" returned: 0 in 0.350s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:52 devstack sudo[109886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2 1G
Aug 04 09:38:52 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:52 devstack sudo[109887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130
Aug 04 09:38:52 devstack sudo[109887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:52 devstack sudo[109887]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130" returned: 0 in 0.344s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:52 devstack sudo[109897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130
Aug 04 09:38:52 devstack sudo[109897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:52 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2 1G" returned: 0 in 0.411s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:52 devstack sudo[109899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2
Aug 04 09:38:52 devstack sudo[109899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:52 devstack sudo[109897]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e.cdf9efbc-ad3f-4247-9b8c-602d32144130" returned: 0 in 0.267s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-quobyte-cdf9efbc-ad3f-4247-9b8c-602d32144130" released by "_delete_snapshot" :: held 1.480s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-quobyte-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" released by "delete_snapshot" :: held 1.506s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:52 devstack sudo[109899]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2" returned: 0 in 0.317s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:52 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2 is being set with open permissions: ugo+rw
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:52 devstack sudo[109906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2
Aug 04 09:38:52 devstack sudo[109906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Created reservations ['3b32a826-3e61-4dd5-b3ce-116a5ea299b2', 'eaa3d3f0-1440-4e9b-bfee-4d42a5b53131', '98312ff6-2ec3-4bfe-b2ab-415e212d3649', 'b606f243-5d80-4a26-8c7e-1f9c181f6bb1'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:52 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Delete snapshot completed successfully.
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-4b0efe58-43e0-45b0-a866-8c2fbd2f88ba tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-cdf9efbc-ad3f-4247-9b8c-602d32144130-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:52 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:53 devstack sudo[109906]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2" returned: 0 in 0.268s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:53 devstack sudo[109909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.info
Aug 04 09:38:53 devstack sudo[109909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:53 devstack sudo[109909]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.info" returned: 0 in 0.251s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:53 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.info is being set with open permissions: ugo+rw
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "cinder-8b6ce97d-21d8-455e-9ced-99bd85c6e44e-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:53 devstack sudo[109915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.info
Aug 04 09:38:53 devstack sudo[109915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-8b6ce97d-21d8-455e-9ced-99bd85c6e44e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "cinder-quobyte-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-quobyte-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" acquired by "delete_volume" :: waited 0.012s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be29e53-972a-41bc-b4fc-d92d5f36110e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:53 devstack sudo[109920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e
Aug 04 09:38:53 devstack sudo[109920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:53 devstack sudo[109915]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.info" returned: 0 in 0.291s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.710s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] Creating offline snapshot 5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d of volume 9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:38:53 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-77c0d18d-e447-405b-b6a4-26bd608fca97 tempest-ProjectReaderTests-1609283064 None] Create snapshot completed successfully
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8602f53d-1757-4241-b289-49012860e07b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:53 devstack sudo[109923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee
Aug 04 09:38:53 devstack sudo[109923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:53 devstack sudo[109920]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" returned: 0 in 0.361s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:53 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:53 devstack sudo[109928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e
Aug 04 09:38:53 devstack sudo[109928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:54 devstack sudo[109923]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee" returned: 0 in 0.362s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:54 devstack sudo[109928]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:54 devstack sudo[109934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d 1G
Aug 04 09:38:54 devstack sudo[109934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" returned: 0 in 0.258s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-quobyte-8b6ce97d-21d8-455e-9ced-99bd85c6e44e" released by "delete_volume" :: held 0.672s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Created reservations ['562b94c5-583c-49f2-894d-ac635f33d132', 'ca70e7c7-51d8-4f15-a585-d74f25c79f70', '8effd6de-55c1-4c16-9b2c-bb64444b98bb', '39500b04-bf0e-4d21-8116-b34852644af7'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:54 devstack sudo[109936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:54 devstack sudo[109936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:54 devstack sudo[109934]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d 1G" returned: 0 in 0.397s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:54 devstack sudo[109936]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.265s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:54 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Deleted volume successfully.
Aug 04 09:38:54 devstack sudo[109944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d
Aug 04 09:38:54 devstack sudo[109944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1a6df7ad-fc8b-4518-ad78-091df85fe0c8 tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-8b6ce97d-21d8-455e-9ced-99bd85c6e44e-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "cinder-e7d93525-0c68-44fe-9a24-a2ad1e76dde9-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-e7d93525-0c68-44fe-9a24-a2ad1e76dde9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "cinder-quobyte-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-quobyte-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" acquired by "delete_volume" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[87289523-5687-4144-b2e9-c66d1814d547]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:54 devstack sudo[109944]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d" returned: 0 in 0.342s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:54 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d is being set with open permissions: ugo+rw
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:54 devstack sudo[109947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9
Aug 04 09:38:54 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-243f3081-092f-4277-9680-79c3457200d2-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:54 devstack sudo[109950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d
Aug 04 09:38:54 devstack sudo[109950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-243f3081-092f-4277-9680-79c3457200d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-243f3081-092f-4277-9680-79c3457200d2" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-243f3081-092f-4277-9680-79c3457200d2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Deleting offline snapshot 243f3081-092f-4277-9680-79c3457200d2 of volume 2db1d24b-f0a2-4f3e-94d9-fa030d080bcc {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] snapshot_file for this snap is: volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77cdd01-4583-4f9d-a0e9-4c8b9c2e1e69]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:54 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:55 devstack sudo[109953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2
Aug 04 09:38:55 devstack sudo[109953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:55 devstack sudo[109950]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d" returned: 0 in 0.277s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:55 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" returned: 0 in 0.421s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:55 devstack sudo[109959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.info
Aug 04 09:38:55 devstack sudo[109959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:55 devstack sudo[109960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9
Aug 04 09:38:55 devstack sudo[109960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:55 devstack sudo[109953]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2" returned: 0 in 0.383s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87d44ee-0f62-476b-9b64-a5e33ab3c522]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:55 devstack sudo[109960]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" returned: 0 in 0.248s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:55 devstack sudo[109959]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.info" returned: 0 in 0.276s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:55 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.info is being set with open permissions: ugo+rw
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-quobyte-e7d93525-0c68-44fe-9a24-a2ad1e76dde9" released by "delete_volume" :: held 0.739s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:55 devstack sudo[109969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.info
Aug 04 09:38:55 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Created reservations ['c37db273-801c-4db7-a5be-d429efaac2df', '98515a0f-d2af-4d01-b7be-f06cf1bb95a1', 'e8658b9c-a5fe-4920-a966-79eee111f938', '8a442fd9-db5f-41c5-a37a-5e2ba51e845c'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:55 devstack sudo[109968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc
Aug 04 09:38:55 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:55 devstack sudo[109972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:55 devstack sudo[109972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:55 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.info" returned: 0 in 0.245s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:55 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-81be5187-56a5-4701-9d15-1a8c6e50dff1 tempest-ProjectMemberTests-2115972071 None] Create snapshot completed successfully
Aug 04 09:38:55 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc" returned: 0 in 0.403s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:55 devstack sudo[109979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2
Aug 04 09:38:55 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:55 devstack sudo[109972]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.282s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:55 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Deleted volume successfully.
Aug 04 09:38:55 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-9b918cd8-e468-4913-b390-516653f0d3c1 tempest-SnapshotDependencyTests-51626884 None] Lock "cinder-e7d93525-0c68-44fe-9a24-a2ad1e76dde9-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:56 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Lock "cinder-5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2" returned: 0 in 0.404s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:56 devstack sudo[109985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2
Aug 04 09:38:56 devstack sudo[109985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Deleting offline snapshot 5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d of volume 9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] snapshot_file for this snap is: volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52d2175-49a1-4ae6-9657-2893196af626]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:56 devstack sudo[109987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d
Aug 04 09:38:56 devstack sudo[109987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:56 devstack sudo[109985]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc.243f3081-092f-4277-9680-79c3457200d2" returned: 0 in 0.283s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-243f3081-092f-4277-9680-79c3457200d2" released by "_delete_snapshot" :: held 1.587s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc" released by "delete_snapshot" :: held 1.616s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Created reservations ['50679b76-4c49-4646-90e3-3a749dc5d5f5', '5b2815e7-9fee-4cf9-b440-80afda1d5ca3', 'e64912d2-567a-4b1a-9d81-6c11c7f75a53', '379d2fa3-abf1-4e27-9c57-47e1cb87d545'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:56 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Delete snapshot completed successfully.
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-84a81da5-4d8b-4e4a-b757-b2882580a210 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-243f3081-092f-4277-9680-79c3457200d2-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:56 devstack sudo[109987]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d" returned: 0 in 0.481s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[050103a1-197d-4949-bba4-4afec089910c]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:56 devstack sudo[109995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee
Aug 04 09:38:56 devstack sudo[109995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:56 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Lock "cinder-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef6ac2b-7099-4fcc-ae01-c2638de6a690]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:57 devstack sudo[109995]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee" returned: 0 in 0.402s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:57 devstack sudo[110001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d
Aug 04 09:38:57 devstack sudo[110001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:57 devstack sudo[110000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc
Aug 04 09:38:57 devstack sudo[110000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:57 devstack sudo[110000]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc" returned: 0 in 0.463s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:57 devstack sudo[110015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc
Aug 04 09:38:57 devstack sudo[110015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:57 devstack sudo[110001]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d" returned: 0 in 0.468s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:57 devstack sudo[110017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d
Aug 04 09:38:57 devstack sudo[110017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:57 devstack sudo[110015]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc" returned: 0 in 0.299s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc" released by "delete_volume" :: held 0.841s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:57 devstack sudo[110017]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee.5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d" returned: 0 in 0.293s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d" released by "_delete_snapshot" :: held 1.771s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee" released by "delete_snapshot" :: held 1.804s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:57 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Created reservations ['e4c593b4-f716-4e69-84a1-ac0eaf28e41c', 'acde2761-08c8-4e58-a619-2b044732d3e0', 'd209c0c5-0ec0-4e4a-9264-a4484be879df', '9bfef7b1-85a3-4fe6-ac81-6299e7dc9011'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Created reservations ['d7e74b27-9da3-4465-a25b-495a323ecc21', 'ade8a789-709c-47ba-8907-b6092d0ce086', '0da28f28-a886-45f9-8406-459e172813d2', 'f968dc4e-4fed-4785-ab3a-34ec2e33200a'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:58 devstack sudo[110021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:58 devstack sudo[110021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:58 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Delete snapshot completed successfully.
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b284fa73-b4ca-4517-90fe-9e14802d826a tempest-ProjectMemberTests-2115972071 None] Lock "cinder-5e5193c1-0915-4fef-a4b7-3a1f9ad95f8d-delete_snapshot" released by "delete_snapshot" :: held 2.058s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Lock "cinder-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f02c07-f71b-47cc-8415-d2e821660c4d]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:58 devstack sudo[110021]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.467s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:58 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Deleted volume successfully.
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e8a68e03-7d94-401b-99c9-253a3546838f tempest-ProjectReaderTests-1609283064 None] Lock "cinder-2db1d24b-f0a2-4f3e-94d9-fa030d080bcc-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:58 devstack sudo[110024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee
Aug 04 09:38:58 devstack sudo[110024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Flow 'volume_create_manager' (6c7fece6-b2e0-4de8-990e-31af3ab96e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffe5ac2-23fb-4052-ae27-d236ef59e6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffe5ac2-23fb-4052-ae27-d236ef59e6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175276374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3784df4-69e0-46d0-809b-9003957829ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7267c934064744ea8ab73ea3d38bda31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:59Z,use_quota=True,user_id='ab14d56468b1434b9da4f2a6c0024d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fc8e16-d4f7-4554-9cab-d7edfab47d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fc8e16-d4f7-4554-9cab-d7edfab47d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77452879-3033-4601-9779-027ccbef687f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77452879-3033-4601-9779-027ccbef687f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3784df4-69e0-46d0-809b-9003957829ed', 'volume_name': 'volume-c3784df4-69e0-46d0-809b-9003957829ed', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fedc970-af73-49a7-9db9-cc0b2d3a9291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fedc970-af73-49a7-9db9-cc0b2d3a9291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11950dda-6b80-4bcc-8f3d-938cadd867da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:58 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Volume c3784df4-69e0-46d0-809b-9003957829ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3784df4-69e0-46d0-809b-9003957829ed', 'volume_size': 1}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175276374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3784df4-69e0-46d0-809b-9003957829ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7267c934064744ea8ab73ea3d38bda31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:38:59Z,use_quota=True,user_id='ab14d56468b1434b9da4f2a6c0024d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Creating volume c3784df4-69e0-46d0-809b-9003957829ed {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:38:58 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:58 devstack sudo[110026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed 1073741824
Aug 04 09:38:58 devstack sudo[110026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:58 devstack sudo[110024]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee" returned: 0 in 0.461s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:59 devstack sudo[110031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee
Aug 04 09:38:59 devstack sudo[110031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:59 devstack sudo[110031]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee" returned: 0 in 0.315s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee" released by "delete_volume" :: held 0.891s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:38:59 devstack sudo[110026]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed 1073741824" returned: 0 in 0.486s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Created reservations ['67ada899-0410-4f26-a08f-31a06f15fdd0', '200d7775-2e95-4008-a35b-12c1045f78c9', 'f8caad36-7589-47a1-9d42-4d703363877f', 'cb9b533d-69f6-4f48-a597-d69d4a79c480'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:38:59 devstack sudo[110037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed
Aug 04 09:38:59 devstack sudo[110037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:38:59 devstack sudo[110039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:38:59 devstack sudo[110039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:38:59 devstack sudo[110037]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed" returned: 0 in 0.388s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11950dda-6b80-4bcc-8f3d-938cadd867da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3784df4-69e0-46d0-809b-9003957829ed', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cea14f-71a6-4b36-b779-63a167d6c049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:38:59 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Volume volume-c3784df4-69e0-46d0-809b-9003957829ed (c3784df4-69e0-46d0-809b-9003957829ed): created successfully
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cea14f-71a6-4b36-b779-63a167d6c049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Flow 'volume_create_manager' (6c7fece6-b2e0-4de8-990e-31af3ab96e3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:38:59 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-39e4dc6b-6002-425e-bdde-9dfbfa152bc2 tempest-ProjectReaderTests-1609283064 None] Created volume successfully.
Aug 04 09:38:59 devstack sudo[110039]: pam_unix(sudo:session): session closed for user root
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.377s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:38:59 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Deleted volume successfully.
Aug 04 09:38:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-c59bbdeb-c8c2-4236-9c7b-bb9c1ae2086e tempest-ProjectMemberTests-2115972071 None] Lock "cinder-9df7cad3-4ddf-448c-bb2a-1fadef2fb9ee-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (8804bb79-3d04-41aa-b0fa-44b02a79da62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f0dcac-9be6-45b9-9933-43e61d8ff513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f0dcac-9be6-45b9-9933-43e61d8ff513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301013368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:00Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827e932f-d854-4bd8-ae60-07548f3c81ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827e932f-d854-4bd8-ae60-07548f3c81ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da1ae85-27c1-4745-b773-9ebedb7e62d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da1ae85-27c1-4745-b773-9ebedb7e62d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2', 'volume_name': 'volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2d1eca-9b63-43da-93b2-bcf337a4955a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2d1eca-9b63-43da-93b2-bcf337a4955a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf2b92a-f503-40dd-8391-266706eace53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:00 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Volume 1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2', 'volume_size': 1}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301013368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:00Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Creating volume 1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:39:00 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:00 devstack sudo[110045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 1073741824
Aug 04 09:39:00 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:00 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 1073741824" returned: 0 in 0.446s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:00 devstack sudo[110051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2
Aug 04 09:39:00 devstack sudo[110051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:01 devstack sudo[110051]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2" returned: 0 in 0.333s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf2b92a-f503-40dd-8391-266706eace53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fabcd2-938d-4c8c-8512-a08ef7eb6ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] Creating offline snapshot cbd4dde1-b33f-42ac-9235-3f2537c281f8 of volume c3784df4-69e0-46d0-809b-9003957829ed {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:39:01 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Volume volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 (1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2): created successfully
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fabcd2-938d-4c8c-8512-a08ef7eb6ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (8804bb79-3d04-41aa-b0fa-44b02a79da62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11e8386-217f-42dc-b581-faabd907f728]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:01 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-25239534-7b49-4044-a3ac-0c34f5e409ba tempest-ProjectMemberTests-2115972071 None] Created volume successfully.
Aug 04 09:39:01 devstack sudo[110054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed
Aug 04 09:39:01 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:01 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed" returned: 0 in 0.384s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:01 devstack sudo[110059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8 1G
Aug 04 09:39:01 devstack sudo[110059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:01 devstack sudo[110059]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8 1G" returned: 0 in 0.464s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3784df4-69e0-46d0-809b-9003957829ed -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:02 devstack sudo[110066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3784df4-69e0-46d0-809b-9003957829ed -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8
Aug 04 09:39:02 devstack sudo[110066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:02 devstack sudo[110066]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3784df4-69e0-46d0-809b-9003957829ed -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8" returned: 0 in 0.337s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:02 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8 is being set with open permissions: ugo+rw
Aug 04 09:39:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:02 devstack sudo[110072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8
Aug 04 09:39:02 devstack sudo[110072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:02 devstack sudo[110072]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8" returned: 0 in 0.288s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:02 devstack sudo[110075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.info
Aug 04 09:39:02 devstack sudo[110075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:02 devstack sudo[110075]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.info" returned: 0 in 0.279s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:02 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.info is being set with open permissions: ugo+rw
Aug 04 09:39:02 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:02 devstack sudo[110078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.info
Aug 04 09:39:02 devstack sudo[110078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:03 devstack sudo[110078]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.info" returned: 0 in 0.300s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.170s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.838s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:03 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] Creating offline snapshot 76077016-b90e-4df6-8f45-f3106e9db154 of volume 1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:39:03 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-09ad6634-32f1-4fb4-919a-4cd5f7cd16ca tempest-ProjectReaderTests-1609283064 None] Create snapshot completed successfully
Aug 04 09:39:03 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f7e66a-1b2a-467e-890e-2bb2d4d3ef0c]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:03 devstack sudo[110082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2
Aug 04 09:39:03 devstack sudo[110082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:03 devstack sudo[110082]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2" returned: 0 in 0.389s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:03 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:03 devstack sudo[110088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154 1G
Aug 04 09:39:03 devstack sudo[110088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:04 devstack sudo[110088]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154 1G" returned: 0 in 0.444s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:04 devstack sudo[110095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154
Aug 04 09:39:04 devstack sudo[110095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-cbd4dde1-b33f-42ac-9235-3f2537c281f8-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-cbd4dde1-b33f-42ac-9235-3f2537c281f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-c3784df4-69e0-46d0-809b-9003957829ed" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-c3784df4-69e0-46d0-809b-9003957829ed" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-cbd4dde1-b33f-42ac-9235-3f2537c281f8" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-cbd4dde1-b33f-42ac-9235-3f2537c281f8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Deleting offline snapshot cbd4dde1-b33f-42ac-9235-3f2537c281f8 of volume c3784df4-69e0-46d0-809b-9003957829ed {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] snapshot_file for this snap is: volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[69962842-02a5-4387-a2db-2b7c20096afb]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:04 devstack sudo[110095]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154" returned: 0 in 0.336s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:04 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154 is being set with open permissions: ugo+rw
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:04 devstack sudo[110101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154
Aug 04 09:39:04 devstack sudo[110101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:04 devstack sudo[110097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8
Aug 04 09:39:04 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:04 devstack sudo[110101]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154" returned: 0 in 0.270s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:04 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8" returned: 0 in 0.434s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3784df4-69e0-46d0-809b-9003957829ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:39:04 devstack sudo[110108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.info
Aug 04 09:39:04 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee82fcac-bfcd-4942-b24d-c1046aa623a7]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:04 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:04 devstack sudo[110110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed
Aug 04 09:39:04 devstack sudo[110110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:05 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.info" returned: 0 in 0.291s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:05 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.info is being set with open permissions: ugo+rw
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:05 devstack sudo[110113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.info
Aug 04 09:39:05 devstack sudo[110113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:05 devstack sudo[110110]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed" returned: 0 in 0.407s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:05 devstack sudo[110118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8
Aug 04 09:39:05 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:05 devstack sudo[110113]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.info" returned: 0 in 0.267s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:05 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-5075ec87-8db8-418c-a32d-f4bcae7df0f1 tempest-ProjectMemberTests-2115972071 None] Create snapshot completed successfully
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-76077016-b90e-4df6-8f45-f3106e9db154-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Lock "cinder-76077016-b90e-4df6-8f45-f3106e9db154-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:05 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8" returned: 0 in 0.430s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-76077016-b90e-4df6-8f45-f3106e9db154" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:05 devstack sudo[110125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8
Aug 04 09:39:05 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-76077016-b90e-4df6-8f45-f3106e9db154" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Deleting offline snapshot 76077016-b90e-4df6-8f45-f3106e9db154 of volume 1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] snapshot_file for this snap is: volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9433956-bc4a-4bc5-89b2-4b38e1819a54]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:05 devstack sudo[110127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154
Aug 04 09:39:05 devstack sudo[110127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:05 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed.cbd4dde1-b33f-42ac-9235-3f2537c281f8" returned: 0 in 0.289s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-cbd4dde1-b33f-42ac-9235-3f2537c281f8" released by "_delete_snapshot" :: held 1.668s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-c3784df4-69e0-46d0-809b-9003957829ed" released by "delete_snapshot" :: held 1.694s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Created reservations ['a394d2bf-db0e-4985-bdf9-743407c43118', 'cea79d35-f369-4f1a-9efb-c143af09b575', 'b4a5b23a-a38d-47bb-9caf-fde7e77b85f1', '4c48d144-8903-479f-a958-b3df67e42613'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:06 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Delete snapshot completed successfully.
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-cbe07ef5-1e38-448a-8051-93218b9a1f26 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-cbd4dde1-b33f-42ac-9235-3f2537c281f8-delete_snapshot" released by "delete_snapshot" :: held 1.862s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:06 devstack sudo[110127]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154" returned: 0 in 0.401s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d52b67-de0b-47b1-b09f-6e5c15ce981a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:06 devstack sudo[110133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2
Aug 04 09:39:06 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-c3784df4-69e0-46d0-809b-9003957829ed-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-c3784df4-69e0-46d0-809b-9003957829ed-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-c3784df4-69e0-46d0-809b-9003957829ed" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-c3784df4-69e0-46d0-809b-9003957829ed" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:06 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2" returned: 0 in 0.376s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df6f768-0419-4be7-9f68-55d831ddcd79]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:06 devstack sudo[110138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154
Aug 04 09:39:06 devstack sudo[110138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:06 devstack sudo[110139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed
Aug 04 09:39:06 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:06 devstack sudo[110138]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154" returned: 0 in 0.337s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:06 devstack sudo[110147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154
Aug 04 09:39:06 devstack sudo[110147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:06 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed" returned: 0 in 0.382s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:07 devstack sudo[110150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed
Aug 04 09:39:07 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:07 devstack sudo[110147]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2.76077016-b90e-4df6-8f45-f3106e9db154" returned: 0 in 0.240s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-76077016-b90e-4df6-8f45-f3106e9db154" released by "_delete_snapshot" :: held 1.459s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2" released by "delete_snapshot" :: held 1.493s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:07 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c3784df4-69e0-46d0-809b-9003957829ed" returned: 0 in 0.248s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-c3784df4-69e0-46d0-809b-9003957829ed" released by "delete_volume" :: held 0.704s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Created reservations ['9abc6232-5d04-4dee-bb7f-246b38632314', 'd3992476-76b2-480b-85ec-ebede85ce3dd', '81cfad6b-6fad-4391-a30f-48986047ee5a', 'd08841c7-1b62-4e45-a231-fb734929bd83'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Created reservations ['9cfd8eae-7f72-43ba-936f-952e8f3edfff', '12248897-a931-4b21-8e3f-09c963794892', '49ec4092-a1be-4412-88d9-e857d8a3a558', '723d2b31-f994-4464-99e7-18d92b4d9b06'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:07 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Delete snapshot completed successfully.
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-da863373-227e-431a-af9d-5a07e2fdb04f tempest-ProjectMemberTests-2115972071 None] Lock "cinder-76077016-b90e-4df6-8f45-f3106e9db154-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:07 devstack sudo[110154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:39:07 devstack sudo[110154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:07 devstack sudo[110154]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.235s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:39:07 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Deleted volume successfully.
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-e1723d34-103a-42c9-a36f-5da969bdbac2 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-c3784df4-69e0-46d0-809b-9003957829ed-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2" acquired by "delete_volume" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b1ac01-4ca1-4c8e-9630-a81813b14e71]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:08 devstack sudo[110157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2
Aug 04 09:39:08 devstack sudo[110157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Flow 'volume_create_manager' (dfeabb7f-8351-486c-a566-78d5e0c3a16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc903388-c95d-45fd-8d15-13ead591d9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:08 devstack sudo[110159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:39:08 devstack sudo[110159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc903388-c95d-45fd-8d15-13ead591d9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-756247576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114c99d6-d692-4d57-8175-80f2e3e58d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7267c934064744ea8ab73ea3d38bda31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:08Z,use_quota=True,user_id='ab14d56468b1434b9da4f2a6c0024d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb05ef06-4c3c-40d7-8710-9b9115decbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb05ef06-4c3c-40d7-8710-9b9115decbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81391203-a02e-4630-810b-533bdc18b66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81391203-a02e-4630-810b-533bdc18b66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114c99d6-d692-4d57-8175-80f2e3e58d1d', 'volume_name': 'volume-114c99d6-d692-4d57-8175-80f2e3e58d1d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c614cc-4431-4399-b3c7-f8c31afd3184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c614cc-4431-4399-b3c7-f8c31afd3184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba4e337-64e1-44af-aaef-b502b625fe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:08 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Volume 114c99d6-d692-4d57-8175-80f2e3e58d1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114c99d6-d692-4d57-8175-80f2e3e58d1d', 'volume_size': 1}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-756247576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114c99d6-d692-4d57-8175-80f2e3e58d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7267c934064744ea8ab73ea3d38bda31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:08Z,use_quota=True,user_id='ab14d56468b1434b9da4f2a6c0024d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Creating volume 114c99d6-d692-4d57-8175-80f2e3e58d1d {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:39:08 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:08 devstack sudo[110161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d 1073741824
Aug 04 09:39:08 devstack sudo[110161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:08 devstack sudo[110157]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2" returned: 0 in 0.369s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:08 devstack sudo[110166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2
Aug 04 09:39:08 devstack sudo[110166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:08 devstack sudo[110159]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.262s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:39:08 devstack sudo[110166]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2" returned: 0 in 0.250s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2" released by "delete_volume" :: held 0.694s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:08 devstack sudo[110161]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Created reservations ['c1fcbbe1-e070-4e4d-a873-dae3db8c656a', '34903eeb-d214-4214-b1c0-d334708a074e', '898d6648-9091-4b93-9107-25595253993a', '2a404eac-bb2b-4ed9-8f2e-bf9110319980'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d 1073741824" returned: 0 in 0.437s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:08 devstack sudo[110174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d
Aug 04 09:39:08 devstack sudo[110174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:08 devstack sudo[110176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:39:08 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:08 devstack sudo[110174]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d" returned: 0 in 0.255s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba4e337-64e1-44af-aaef-b502b625fe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114c99d6-d692-4d57-8175-80f2e3e58d1d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8497dc-8335-453f-bb08-27c6a8cde64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:08 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.252s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:39:08 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Volume volume-114c99d6-d692-4d57-8175-80f2e3e58d1d (114c99d6-d692-4d57-8175-80f2e3e58d1d): created successfully
Aug 04 09:39:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8497dc-8335-453f-bb08-27c6a8cde64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Flow 'volume_create_manager' (dfeabb7f-8351-486c-a566-78d5e0c3a16b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:09 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Deleted volume successfully.
Aug 04 09:39:09 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-09affb63-3a7d-443d-aaae-b350c6568ae0 tempest-ProjectReaderTests-1609283064 None] Created volume successfully.
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-b8bc0012-9afa-451c-9e28-fcf31ae3c282 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-1313d62a-b37f-4cf7-bbcf-7ccb03cf3fb2-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] Creating offline snapshot aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2 of volume 114c99d6-d692-4d57-8175-80f2e3e58d1d {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (5fbbde41-14bd-4962-936d-cb1bad960f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9031ee34-bf76-421d-beb1-6e414e21a9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aac8d41-e42a-4cb7-b818-cc197e2f7e1a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9031ee34-bf76-421d-beb1-6e414e21a9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858536154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e5cf6d-0c0d-40fc-bdb6-53da945808a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:09Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea750b7-f792-45e5-965b-cb1bc8b149a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea750b7-f792-45e5-965b-cb1bc8b149a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fcc7d4-0edb-42be-9d52-ec852d73eea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fcc7d4-0edb-42be-9d52-ec852d73eea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2e5cf6d-0c0d-40fc-bdb6-53da945808a3', 'volume_name': 'volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e89ae4-4c24-40e3-b4bb-39fc229dd212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e89ae4-4c24-40e3-b4bb-39fc229dd212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706687b4-75b6-405a-a566-e80142e20f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:09 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Volume e2e5cf6d-0c0d-40fc-bdb6-53da945808a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3', 'volume_size': 1}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:09 devstack sudo[110181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d
Aug 04 09:39:09 devstack sudo[110181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:09 devstack sudo[110181]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d" returned: 0 in 0.355s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:09 devstack sudo[110186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2 1G
Aug 04 09:39:09 devstack sudo[110186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:10 devstack sudo[110186]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2 1G" returned: 0 in 0.392s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114c99d6-d692-4d57-8175-80f2e3e58d1d -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:10 devstack sudo[110193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114c99d6-d692-4d57-8175-80f2e3e58d1d -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2
Aug 04 09:39:10 devstack sudo[110193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:10 devstack sudo[110193]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114c99d6-d692-4d57-8175-80f2e3e58d1d -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2" returned: 0 in 0.282s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:10 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2 is being set with open permissions: ugo+rw
Aug 04 09:39:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:10 devstack sudo[110198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2
Aug 04 09:39:10 devstack sudo[110198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:10 devstack sudo[110198]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2" returned: 0 in 0.244s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:10 devstack sudo[110201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.info
Aug 04 09:39:10 devstack sudo[110201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:11 devstack sudo[110201]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.info" returned: 0 in 0.238s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:11 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.info is being set with open permissions: ugo+rw
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:11 devstack sudo[110204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.info
Aug 04 09:39:11 devstack sudo[110204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:11 devstack sudo[110204]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.info" returned: 0 in 0.239s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.741s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858536154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e5cf6d-0c0d-40fc-bdb6-53da945808a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:09Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Creating volume e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:39:11 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:11 devstack sudo[110207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 1073741824
Aug 04 09:39:11 devstack sudo[110207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4aaefc1d-ec7a-4fb4-aae7-b8e8561d0962 tempest-ProjectReaderTests-1609283064 None] Create snapshot completed successfully
Aug 04 09:39:11 devstack sudo[110207]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 1073741824" returned: 0 in 0.399s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:11 devstack sudo[110212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3
Aug 04 09:39:11 devstack sudo[110212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:12 devstack sudo[110212]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3" returned: 0 in 0.235s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706687b4-75b6-405a-a566-e80142e20f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456b80f4-7325-4b25-bad6-ab5b544f59a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:12 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Volume volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 (e2e5cf6d-0c0d-40fc-bdb6-53da945808a3): created successfully
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456b80f4-7325-4b25-bad6-ab5b544f59a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (5fbbde41-14bd-4962-936d-cb1bad960f43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:12 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-7dc7de43-e2d3-4c3f-9a75-dced73c5d3db tempest-ProjectMemberTests-2115972071 None] Created volume successfully.
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-114c99d6-d692-4d57-8175-80f2e3e58d1d" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-114c99d6-d692-4d57-8175-80f2e3e58d1d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Deleting offline snapshot aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2 of volume 114c99d6-d692-4d57-8175-80f2e3e58d1d {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] snapshot_file for this snap is: volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[027caa98-d1e3-491f-8214-77d484b68ba1]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:12 devstack sudo[110215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2
Aug 04 09:39:12 devstack sudo[110215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] Creating offline snapshot c2868e04-3baa-4afd-a906-538d176f5d46 of volume e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[526b2d91-cded-4557-a896-6d2b3e2abe69]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:12 devstack sudo[110217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3
Aug 04 09:39:12 devstack sudo[110217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:12 devstack sudo[110215]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2" returned: 0 in 0.417s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-114c99d6-d692-4d57-8175-80f2e3e58d1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d6783f-6af7-48b5-a46c-5bf9a1728364]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:13 devstack sudo[110222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d
Aug 04 09:39:13 devstack sudo[110222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:13 devstack sudo[110217]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3" returned: 0 in 0.384s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:13 devstack sudo[110227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46 1G
Aug 04 09:39:13 devstack sudo[110227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:13 devstack sudo[110222]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d" returned: 0 in 0.399s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:13 devstack sudo[110232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2
Aug 04 09:39:13 devstack sudo[110232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:13 devstack sudo[110227]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46 1G" returned: 0 in 0.555s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:13 devstack sudo[110240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46
Aug 04 09:39:13 devstack sudo[110240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:13 devstack sudo[110232]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2" returned: 0 in 0.477s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:13 devstack sudo[110243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2
Aug 04 09:39:13 devstack sudo[110243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:14 devstack sudo[110240]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46" returned: 0 in 0.351s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:14 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46 is being set with open permissions: ugo+rw
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:14 devstack sudo[110248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46
Aug 04 09:39:14 devstack sudo[110248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:14 devstack sudo[110243]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d.aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2" returned: 0 in 0.291s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2" released by "_delete_snapshot" :: held 1.699s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-114c99d6-d692-4d57-8175-80f2e3e58d1d" released by "delete_snapshot" :: held 1.726s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Created reservations ['6b568c21-0486-454d-abfd-a648605fdd51', 'f43a554e-5e7c-4add-96b1-a8e1bd934904', 'a33341a1-94e2-4ea9-ba59-be858317f511', '77f5929b-ef8e-4a75-9e3f-90c0e8d1be98'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:14 devstack sudo[110248]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46" returned: 0 in 0.275s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:14 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Delete snapshot completed successfully.
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-5886c613-f462-44bb-9461-137e902ce053 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-aefb82d1-bcc3-4344-b3da-fd17fbb1c7d2-delete_snapshot" released by "delete_snapshot" :: held 1.898s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:14 devstack sudo[110252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.info
Aug 04 09:39:14 devstack sudo[110252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-114c99d6-d692-4d57-8175-80f2e3e58d1d-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-114c99d6-d692-4d57-8175-80f2e3e58d1d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:14 devstack sudo[110252]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.info" returned: 0 in 0.320s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:14 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.info is being set with open permissions: ugo+rw
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-114c99d6-d692-4d57-8175-80f2e3e58d1d" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:14 devstack sudo[110255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.info
Aug 04 09:39:14 devstack sudo[110255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-114c99d6-d692-4d57-8175-80f2e3e58d1d" acquired by "delete_volume" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8793ffe8-a55a-4ccb-aaa8-ef403a1d7ee9]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:14 devstack sudo[110257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d
Aug 04 09:39:14 devstack sudo[110257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:14 devstack sudo[110255]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.info" returned: 0 in 0.278s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.269s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:15 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-321e534a-511d-4229-b676-2e32dd627319 tempest-ProjectMemberTests-2115972071 None] Create snapshot completed successfully
Aug 04 09:39:15 devstack sudo[110257]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d" returned: 0 in 0.392s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:15 devstack sudo[110263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d
Aug 04 09:39:15 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:15 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-114c99d6-d692-4d57-8175-80f2e3e58d1d" returned: 0 in 0.257s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-114c99d6-d692-4d57-8175-80f2e3e58d1d" released by "delete_volume" :: held 0.729s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Created reservations ['5730db81-5737-4f57-b3bd-bca4c6f7255f', '5b7db7aa-f682-4a74-a31f-b2037eafe91b', '271f2085-4d41-4b99-9ec3-f174499eadff', 'de5f8bc0-b18c-4215-a36f-f13316851736'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:15 devstack sudo[110266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:39:15 devstack sudo[110266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:15 devstack sudo[110266]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.243s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:39:15 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Deleted volume successfully.
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-a9af8cd8-6840-4e30-bba4-1212c6499bd8 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-114c99d6-d692-4d57-8175-80f2e3e58d1d-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-c2868e04-3baa-4afd-a906-538d176f5d46-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-c2868e04-3baa-4afd-a906-538d176f5d46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-c2868e04-3baa-4afd-a906-538d176f5d46" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-c2868e04-3baa-4afd-a906-538d176f5d46" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Deleting offline snapshot c2868e04-3baa-4afd-a906-538d176f5d46 of volume e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] snapshot_file for this snap is: volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a91e867-b3f0-4ac0-8187-cf5c68270a1a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:16 devstack sudo[110269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46
Aug 04 09:39:16 devstack sudo[110269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:16 devstack sudo[110269]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46" returned: 0 in 0.424s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[51758d74-9904-4446-88dc-22c03e75ce29]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Flow 'volume_create_manager' (0a5851ff-60f7-40ea-bfcf-66e03eabbb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c3b920-079c-438a-afb0-7f4ebb79e0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c3b920-079c-438a-afb0-7f4ebb79e0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-743843002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ff67eb-89b6-4c51-8fce-3387050a9642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7267c934064744ea8ab73ea3d38bda31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:16Z,use_quota=True,user_id='ab14d56468b1434b9da4f2a6c0024d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f37763-1363-4919-a243-44da071c0096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f37763-1363-4919-a243-44da071c0096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:16 devstack sudo[110274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3
Aug 04 09:39:16 devstack sudo[110274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d234ed-bef1-4920-aec3-5f575aa1eddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d234ed-bef1-4920-aec3-5f575aa1eddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46ff67eb-89b6-4c51-8fce-3387050a9642', 'volume_name': 'volume-46ff67eb-89b6-4c51-8fce-3387050a9642', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a55ba50-4f14-417f-9acf-b5b78af5923b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a55ba50-4f14-417f-9acf-b5b78af5923b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd28497-5d44-405d-b9cf-990bd7c32489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:16 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Volume 46ff67eb-89b6-4c51-8fce-3387050a9642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46ff67eb-89b6-4c51-8fce-3387050a9642', 'volume_size': 1}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-743843002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ff67eb-89b6-4c51-8fce-3387050a9642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7267c934064744ea8ab73ea3d38bda31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:16Z,use_quota=True,user_id='ab14d56468b1434b9da4f2a6c0024d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Creating volume 46ff67eb-89b6-4c51-8fce-3387050a9642 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:39:16 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:16 devstack sudo[110276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642 1073741824
Aug 04 09:39:16 devstack sudo[110276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:16 devstack sudo[110274]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3" returned: 0 in 0.364s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:16 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:16 devstack sudo[110283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46
Aug 04 09:39:16 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:17 devstack sudo[110276]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642 1073741824" returned: 0 in 0.421s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:17 devstack sudo[110289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642
Aug 04 09:39:17 devstack sudo[110289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:17 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46" returned: 0 in 0.343s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:17 devstack sudo[110291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46
Aug 04 09:39:17 devstack sudo[110291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:17 devstack sudo[110289]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642" returned: 0 in 0.273s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd28497-5d44-405d-b9cf-990bd7c32489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ff67eb-89b6-4c51-8fce-3387050a9642', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4603e214-bb39-4e5e-827a-045f9df6d611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:17 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Volume volume-46ff67eb-89b6-4c51-8fce-3387050a9642 (46ff67eb-89b6-4c51-8fce-3387050a9642): created successfully
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4603e214-bb39-4e5e-827a-045f9df6d611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Flow 'volume_create_manager' (0a5851ff-60f7-40ea-bfcf-66e03eabbb65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:17 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-d797a33c-de8f-48e4-9b37-675874f34700 tempest-ProjectReaderTests-1609283064 None] Created volume successfully.
Aug 04 09:39:17 devstack sudo[110291]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3.c2868e04-3baa-4afd-a906-538d176f5d46" returned: 0 in 0.264s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-c2868e04-3baa-4afd-a906-538d176f5d46" released by "_delete_snapshot" :: held 1.503s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3" released by "delete_snapshot" :: held 1.523s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Created reservations ['4285478b-2f7c-4599-a658-173b40b2d248', 'd53c230a-d033-4dac-b7e9-ea6401726560', 'a06f1d6d-1e0c-4f16-990c-48a328bca102', '8aad095a-af4b-4f42-b17c-33e68e484b90'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:17 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Delete snapshot completed successfully.
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-fbabc02c-aa1d-40e2-b8eb-4bc840bbaf45 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-c2868e04-3baa-4afd-a906-538d176f5d46-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] Creating offline snapshot 971d6ba9-7e8f-410e-8682-a9f84a23683f of volume 46ff67eb-89b6-4c51-8fce-3387050a9642 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca597005-f19b-41ff-b2a4-25e3492f72f0]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:17 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:17 devstack sudo[110295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642
Aug 04 09:39:17 devstack sudo[110295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:18 devstack sudo[110295]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642" returned: 0 in 0.386s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:18 devstack sudo[110300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f 1G
Aug 04 09:39:18 devstack sudo[110300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f4fbec-b232-4a2b-99ab-67aecf1b4508]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:18 devstack sudo[110302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3
Aug 04 09:39:18 devstack sudo[110302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:18 devstack sudo[110300]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f 1G" returned: 0 in 0.448s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46ff67eb-89b6-4c51-8fce-3387050a9642 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:18 devstack sudo[110309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46ff67eb-89b6-4c51-8fce-3387050a9642 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f
Aug 04 09:39:18 devstack sudo[110309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:18 devstack sudo[110302]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3" returned: 0 in 0.377s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:18 devstack sudo[110312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3
Aug 04 09:39:18 devstack sudo[110312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:18 devstack sudo[110312]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3" returned: 0 in 0.252s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:18 devstack sudo[110309]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46ff67eb-89b6-4c51-8fce-3387050a9642 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f" returned: 0 in 0.322s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:18 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f is being set with open permissions: ugo+rw
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3" released by "delete_volume" :: held 0.695s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:18 devstack sudo[110318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f
Aug 04 09:39:18 devstack sudo[110318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:18 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Created reservations ['7b053ab9-732b-48e6-bda1-ac6b9c1a53cf', '9fdcf5ae-0a4a-4e93-9d7d-a23b89db38af', '3dd1ee59-7421-4966-b9c9-81b7c3689f88', '77cce203-aa75-4ec2-bcbe-c8e8a235c016'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:19 devstack sudo[110320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:39:19 devstack sudo[110320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:19 devstack sudo[110318]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f" returned: 0 in 0.263s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:19 devstack sudo[110323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.info
Aug 04 09:39:19 devstack sudo[110323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:19 devstack sudo[110320]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.270s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:39:19 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Deleted volume successfully.
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-1a852321-1f8c-4a4b-b961-0dd226699066 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-e2e5cf6d-0c0d-40fc-bdb6-53da945808a3-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:19 devstack sudo[110323]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.info" returned: 0 in 0.295s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:19 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.info is being set with open permissions: ugo+rw
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:19 devstack sudo[110327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.info
Aug 04 09:39:19 devstack sudo[110327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:19 devstack sudo[110327]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.info" returned: 0 in 0.329s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (0a78d3fb-10f3-4a48-9908-cf352c57a839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f167b48-8af0-479f-8ee3-6b390a5648a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:19 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-c120b099-47dd-4326-a7dc-4f22aa3d2cae tempest-ProjectReaderTests-1609283064 None] Create snapshot completed successfully
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f167b48-8af0-479f-8ee3-6b390a5648a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820491956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a4bba7-6c2f-4519-939e-c1d406a850c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:20Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ed81b7-2842-4847-aa46-6f351689562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ed81b7-2842-4847-aa46-6f351689562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208f09ae-725b-4b31-a7be-25d7c045510a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208f09ae-725b-4b31-a7be-25d7c045510a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a4bba7-6c2f-4519-939e-c1d406a850c3', 'volume_name': 'volume-86a4bba7-6c2f-4519-939e-c1d406a850c3', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62d82b5-2a95-465a-ab68-98a41dbadd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62d82b5-2a95-465a-ab68-98a41dbadd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976de058-3fa4-402a-8932-5cc15f1607f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:19 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Volume 86a4bba7-6c2f-4519-939e-c1d406a850c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a4bba7-6c2f-4519-939e-c1d406a850c3', 'volume_size': 1}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820491956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a4bba7-6c2f-4519-939e-c1d406a850c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:20Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Creating volume 86a4bba7-6c2f-4519-939e-c1d406a850c3 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:39:19 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:39:19 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:19 devstack sudo[110330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3 1073741824
Aug 04 09:39:19 devstack sudo[110330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:20 devstack sudo[110330]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3 1073741824" returned: 0 in 0.421s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:20 devstack sudo[110336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3
Aug 04 09:39:20 devstack sudo[110336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:20 devstack sudo[110336]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3" returned: 0 in 0.239s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976de058-3fa4-402a-8932-5cc15f1607f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a4bba7-6c2f-4519-939e-c1d406a850c3', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef57391-7e70-4e09-877d-e0d6ce7f1c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:20 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Volume volume-86a4bba7-6c2f-4519-939e-c1d406a850c3 (86a4bba7-6c2f-4519-939e-c1d406a850c3): created successfully
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef57391-7e70-4e09-877d-e0d6ce7f1c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (0a78d3fb-10f3-4a48-9908-cf352c57a839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:20 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-fd150428-e9ea-41cf-87ef-a3d10ac1a316 tempest-ProjectMemberTests-2115972071 None] Created volume successfully.
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-971d6ba9-7e8f-410e-8682-a9f84a23683f-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Lock "cinder-971d6ba9-7e8f-410e-8682-a9f84a23683f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-46ff67eb-89b6-4c51-8fce-3387050a9642" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-46ff67eb-89b6-4c51-8fce-3387050a9642" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-971d6ba9-7e8f-410e-8682-a9f84a23683f" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-971d6ba9-7e8f-410e-8682-a9f84a23683f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Deleting offline snapshot 971d6ba9-7e8f-410e-8682-a9f84a23683f of volume 46ff67eb-89b6-4c51-8fce-3387050a9642 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:39:20 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] snapshot_file for this snap is: volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3966c6-2600-4c51-83ec-69c2cb3d8a5e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] Creating offline snapshot 8821f028-cb81-4ff9-b989-9a181e24a975 of volume 86a4bba7-6c2f-4519-939e-c1d406a850c3 {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7266f094-3ce7-411c-91e3-91f25451763f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:21 devstack sudo[110339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f
Aug 04 09:39:21 devstack sudo[110339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:21 devstack sudo[110340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3
Aug 04 09:39:21 devstack sudo[110340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:21 devstack sudo[110339]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f" returned: 0 in 0.375s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46ff67eb-89b6-4c51-8fce-3387050a9642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c1b338-fc0d-402c-904e-13e7fc2d5c37]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:21 devstack sudo[110340]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3" returned: 0 in 0.425s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:21 devstack sudo[110348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642
Aug 04 09:39:21 devstack sudo[110348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:21 devstack sudo[110350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975 1G
Aug 04 09:39:21 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:21 devstack sudo[110348]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642" returned: 0 in 0.405s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:21 devstack sudo[110360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f
Aug 04 09:39:21 devstack sudo[110360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:21 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975 1G" returned: 0 in 0.457s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:21 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86a4bba7-6c2f-4519-939e-c1d406a850c3 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:22 devstack sudo[110362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86a4bba7-6c2f-4519-939e-c1d406a850c3 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975
Aug 04 09:39:22 devstack sudo[110362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:22 devstack sudo[110360]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f" returned: 0 in 0.360s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:22 devstack sudo[110368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f
Aug 04 09:39:22 devstack sudo[110368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:22 devstack sudo[110362]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86a4bba7-6c2f-4519-939e-c1d406a850c3 -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975" returned: 0 in 0.304s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:22 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975 is being set with open permissions: ugo+rw
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:22 devstack sudo[110372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975
Aug 04 09:39:22 devstack sudo[110372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:22 devstack sudo[110368]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642.971d6ba9-7e8f-410e-8682-a9f84a23683f" returned: 0 in 0.254s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-971d6ba9-7e8f-410e-8682-a9f84a23683f" released by "_delete_snapshot" :: held 1.525s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-46ff67eb-89b6-4c51-8fce-3387050a9642" released by "delete_snapshot" :: held 1.556s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:22 devstack sudo[110372]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975" returned: 0 in 0.286s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Created reservations ['d03c1f9e-5aff-4278-b63e-ac1331637c8d', 'e9ea7047-ac70-4530-9fed-6a2d44778385', 'ca67a144-109a-4bae-b42a-ad16acc2fa45', '0bcfd40c-df5e-474f-8c37-0d69635bda6a'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:22 devstack sudo[110376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.info
Aug 04 09:39:22 devstack sudo[110376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:22 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Delete snapshot completed successfully.
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f41e6fb0-2d8e-472e-9905-2bf434c58dce tempest-ProjectReaderTests-1609283064 None] Lock "cinder-971d6ba9-7e8f-410e-8682-a9f84a23683f-delete_snapshot" released by "delete_snapshot" :: held 1.773s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:22 devstack sudo[110376]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.info" returned: 0 in 0.264s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:22 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.info is being set with open permissions: ugo+rw
Aug 04 09:39:22 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:22 devstack sudo[110379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.info
Aug 04 09:39:22 devstack sudo[110379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-46ff67eb-89b6-4c51-8fce-3387050a9642-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-46ff67eb-89b6-4c51-8fce-3387050a9642-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:23 devstack sudo[110379]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.info" returned: 0 in 0.277s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-46ff67eb-89b6-4c51-8fce-3387050a9642" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-46ff67eb-89b6-4c51-8fce-3387050a9642" acquired by "delete_volume" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:23 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-90ecfb62-9072-46df-94d0-bd2badd3169e tempest-ProjectMemberTests-2115972071 None] Create snapshot completed successfully
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed34ba1-480a-4659-9ebf-9471b8431de5]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:23 devstack sudo[110382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642
Aug 04 09:39:23 devstack sudo[110382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:23 devstack sudo[110382]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642" returned: 0 in 0.366s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:23 devstack sudo[110387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642
Aug 04 09:39:23 devstack sudo[110387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:23 devstack sudo[110387]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-46ff67eb-89b6-4c51-8fce-3387050a9642" returned: 0 in 0.247s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-46ff67eb-89b6-4c51-8fce-3387050a9642" released by "delete_volume" :: held 0.677s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Created reservations ['3797166a-c7cc-418e-ad64-6eb54256cd1d', '4a857cf6-bbf2-4b73-b897-8b7aac219350', '22fb6b0f-1e66-4a27-8a76-359dfddaea29', '20be2c52-d7c3-45a4-98c1-525ab583310c'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:23 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:24 devstack sudo[110390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:39:24 devstack sudo[110390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-8821f028-cb81-4ff9-b989-9a181e24a975-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:24 devstack sudo[110390]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.263s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:39:24 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Deleted volume successfully.
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-8821f028-cb81-4ff9-b989-9a181e24a975-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-86a4bba7-6c2f-4519-939e-c1d406a850c3" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-86a4bba7-6c2f-4519-939e-c1d406a850c3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-8821f028-cb81-4ff9-b989-9a181e24a975" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-242d79e4-1761-492d-9db1-4c0b12665e42 tempest-ProjectReaderTests-1609283064 None] Lock "cinder-46ff67eb-89b6-4c51-8fce-3387050a9642-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-8821f028-cb81-4ff9-b989-9a181e24a975" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Deleting offline snapshot 8821f028-cb81-4ff9-b989-9a181e24a975 of volume 86a4bba7-6c2f-4519-939e-c1d406a850c3 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] snapshot_file for this snap is: volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa7c732-77ff-48e8-a52a-8249118eec0b]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:24 devstack sudo[110393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975
Aug 04 09:39:24 devstack sudo[110393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:24 devstack sudo[110393]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975" returned: 0 in 0.389s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86a4bba7-6c2f-4519-939e-c1d406a850c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2230d9-9464-4ad4-93a1-94d75c384f6c]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Flow 'volume_create_manager' (4d04fe61-7f1d-44e0-9d9d-5d585c44efa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a64920-1685-40a0-a490-bd21249570d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a64920-1685-40a0-a490-bd21249570d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1641065113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0626786-5938-462e-af6f-ac34a415172d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7267c934064744ea8ab73ea3d38bda31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:25Z,use_quota=True,user_id='ab14d56468b1434b9da4f2a6c0024d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd39f6e-6708-4d47-a0af-e6e8c1b49284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd39f6e-6708-4d47-a0af-e6e8c1b49284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd0f6dd-6264-4679-828f-3a7cbcbac2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd0f6dd-6264-4679-828f-3a7cbcbac2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0626786-5938-462e-af6f-ac34a415172d', 'volume_name': 'volume-a0626786-5938-462e-af6f-ac34a415172d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403ac05c-5279-466f-a3b9-d364d1431077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403ac05c-5279-466f-a3b9-d364d1431077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:24 devstack sudo[110398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3
Aug 04 09:39:24 devstack sudo[110398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0cccd7-f307-4957-8d47-648ada2aadef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:24 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Volume a0626786-5938-462e-af6f-ac34a415172d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0626786-5938-462e-af6f-ac34a415172d', 'volume_size': 1}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1641065113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0626786-5938-462e-af6f-ac34a415172d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7267c934064744ea8ab73ea3d38bda31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:25Z,use_quota=True,user_id='ab14d56468b1434b9da4f2a6c0024d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Creating volume a0626786-5938-462e-af6f-ac34a415172d {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:39:24 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:39:24 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:24 devstack sudo[110400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d 1073741824
Aug 04 09:39:24 devstack sudo[110400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:25 devstack sudo[110398]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3" returned: 0 in 0.373s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:25 devstack sudo[110409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975
Aug 04 09:39:25 devstack sudo[110409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:25 devstack sudo[110400]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d 1073741824" returned: 0 in 0.457s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:25 devstack sudo[110415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d
Aug 04 09:39:25 devstack sudo[110415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:25 devstack sudo[110409]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975" returned: 0 in 0.360s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:25 devstack sudo[110418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975
Aug 04 09:39:25 devstack sudo[110418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:25 devstack sudo[110415]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d" returned: 0 in 0.272s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0cccd7-f307-4957-8d47-648ada2aadef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0626786-5938-462e-af6f-ac34a415172d', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4551e480-35e1-4b94-aaed-4b5c369893f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:25 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Volume volume-a0626786-5938-462e-af6f-ac34a415172d (a0626786-5938-462e-af6f-ac34a415172d): created successfully
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4551e480-35e1-4b94-aaed-4b5c369893f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Flow 'volume_create_manager' (4d04fe61-7f1d-44e0-9d9d-5d585c44efa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:25 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-4c0bc565-42b0-4f4f-a256-bc1fd5895944 tempest-ProjectReaderTests-1609283064 None] Created volume successfully.
Aug 04 09:39:25 devstack sudo[110418]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3.8821f028-cb81-4ff9-b989-9a181e24a975" returned: 0 in 0.257s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-8821f028-cb81-4ff9-b989-9a181e24a975" released by "_delete_snapshot" :: held 1.471s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-86a4bba7-6c2f-4519-939e-c1d406a850c3" released by "delete_snapshot" :: held 1.497s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Created reservations ['fb2ec7cc-cc3b-471e-a91d-0153d2545390', 'd92e37a6-b67f-4aca-9606-c03e1cc47841', 'df83f2db-66ec-4c53-affa-70091b9760bf', 'f658886b-08db-4f99-9133-02f1ce0deb95'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:25 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Delete snapshot completed successfully.
Aug 04 09:39:25 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-66837853-f56c-46f6-a469-78fdf11e4c75 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-8821f028-cb81-4ff9-b989-9a181e24a975-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-86a4bba7-6c2f-4519-939e-c1d406a850c3-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Lock "cinder-86a4bba7-6c2f-4519-939e-c1d406a850c3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-86a4bba7-6c2f-4519-939e-c1d406a850c3" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:26 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-86a4bba7-6c2f-4519-939e-c1d406a850c3" acquired by "delete_volume" :: waited 0.013s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:26 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0cd170-938c-45eb-bd51-c4fc801b0d10]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:26 devstack sudo[110422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3
Aug 04 09:39:26 devstack sudo[110422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:26 devstack sudo[110422]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3" returned: 0 in 0.348s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:26 devstack sudo[110427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3
Aug 04 09:39:26 devstack sudo[110427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:26 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] Creating offline snapshot 255f53a9-1279-4710-92a4-7d0e7cff36b1 of volume a0626786-5938-462e-af6f-ac34a415172d {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cd85a2-bda1-4789-826d-d0e7475ef4d2]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:27 devstack sudo[110427]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-86a4bba7-6c2f-4519-939e-c1d406a850c3" returned: 0 in 0.251s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-86a4bba7-6c2f-4519-939e-c1d406a850c3" released by "delete_volume" :: held 0.657s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:27 devstack sudo[110429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d
Aug 04 09:39:27 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Created reservations ['0299cdff-a28d-449a-8850-93fa2efd5a8c', '23cea783-62ab-458b-83eb-ec6d8953e4c1', '35555ef6-90ac-4270-a6a5-6f4baf70b286', '3abe2ce1-ced1-467b-8958-2d8184550ac8'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:27 devstack sudo[110432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:39:27 devstack sudo[110432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:27 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d" returned: 0 in 0.381s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:27 devstack sudo[110437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1 1G
Aug 04 09:39:27 devstack sudo[110437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:27 devstack sudo[110432]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.263s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:39:27 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Deleted volume successfully.
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6025722c-bb55-423e-a530-201f2b62ca1b tempest-ProjectMemberTests-2115972071 None] Lock "cinder-86a4bba7-6c2f-4519-939e-c1d406a850c3-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:27 devstack sudo[110437]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1 1G" returned: 0 in 0.489s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:27 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0626786-5938-462e-af6f-ac34a415172d -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:27 devstack sudo[110446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0626786-5938-462e-af6f-ac34a415172d -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1
Aug 04 09:39:27 devstack sudo[110446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (de1dd4e1-cf73-4ca7-9a77-4f7472e0e314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47f9c67-4471-46cc-b247-a28567300fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47f9c67-4471-46cc-b247-a28567300fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-349655101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29d8c62-5e0f-492e-af6d-1751cf39c21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:28Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ecf1e5-c8b4-4bb0-9ecd-84527b967f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ecf1e5-c8b4-4bb0-9ecd-84527b967f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20c492c-0f83-4118-b25a-c7a85b5180ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20c492c-0f83-4118-b25a-c7a85b5180ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29d8c62-5e0f-492e-af6d-1751cf39c21a', 'volume_name': 'volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7facd8-0ec3-486b-a149-bde05d3d9fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7facd8-0ec3-486b-a149-bde05d3d9fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b247caeb-fb92-4cad-af90-6dd46a5ab17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:28 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Volume c29d8c62-5e0f-492e-af6d-1751cf39c21a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a', 'volume_size': 1}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:28 devstack sudo[110446]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0626786-5938-462e-af6f-ac34a415172d -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1" returned: 0 in 0.296s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:28 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1 is being set with open permissions: ugo+rw
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:28 devstack sudo[110451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1
Aug 04 09:39:28 devstack sudo[110451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:28 devstack sudo[110451]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1" returned: 0 in 0.234s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:28 devstack sudo[110454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.info
Aug 04 09:39:28 devstack sudo[110454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:28 devstack sudo[110454]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.info" returned: 0 in 0.236s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:28 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.info is being set with open permissions: ugo+rw
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:28 devstack sudo[110457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.info
Aug 04 09:39:28 devstack sudo[110457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:28 devstack sudo[110457]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.info" returned: 0 in 0.242s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-349655101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29d8c62-5e0f-492e-af6d-1751cf39c21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dcfba5500a481ea227b2dbe91b9d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:28Z,use_quota=True,user_id='07b8c8eee4e3496da1249b53cca650d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Creating volume c29d8c62-5e0f-492e-af6d-1751cf39c21a {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:39:28 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:39:28 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:29 devstack sudo[110460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a 1073741824
Aug 04 09:39:29 devstack sudo[110460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:29 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-decc122a-d1d8-42c7-a3f7-9c0693c4c639 tempest-ProjectReaderTests-1609283064 None] Create snapshot completed successfully
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-255f53a9-1279-4710-92a4-7d0e7cff36b1-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Lock "cinder-255f53a9-1279-4710-92a4-7d0e7cff36b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-a0626786-5938-462e-af6f-ac34a415172d" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-a0626786-5938-462e-af6f-ac34a415172d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-255f53a9-1279-4710-92a4-7d0e7cff36b1" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-255f53a9-1279-4710-92a4-7d0e7cff36b1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Deleting offline snapshot 255f53a9-1279-4710-92a4-7d0e7cff36b1 of volume a0626786-5938-462e-af6f-ac34a415172d {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] snapshot_file for this snap is: volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ac08d4-532f-4d7e-9571-41b16423d9dd]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:29 devstack sudo[110465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1
Aug 04 09:39:29 devstack sudo[110465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:29 devstack sudo[110460]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a 1073741824" returned: 0 in 0.463s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:29 devstack sudo[110467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a
Aug 04 09:39:29 devstack sudo[110467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:29 devstack sudo[110465]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1" returned: 0 in 0.376s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0626786-5938-462e-af6f-ac34a415172d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04dc4a4-8b99-47f9-8880-df23454a717e]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:29 devstack sudo[110472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d
Aug 04 09:39:29 devstack sudo[110472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:29 devstack sudo[110467]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a" returned: 0 in 0.284s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b247caeb-fb92-4cad-af90-6dd46a5ab17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e670576f-7625-4ec1-8895-e581359bfe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:29 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Volume volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a (c29d8c62-5e0f-492e-af6d-1751cf39c21a): created successfully
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e670576f-7625-4ec1-8895-e581359bfe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:29 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Flow 'volume_create_manager' (de1dd4e1-cf73-4ca7-9a77-4f7472e0e314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:29 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-36a80dba-34c8-4545-b4c8-5ff8edb65701 tempest-ProjectMemberTests-2115972071 None] Created volume successfully.
Aug 04 09:39:30 devstack sudo[110472]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d" returned: 0 in 0.445s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:30 devstack sudo[110479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1
Aug 04 09:39:30 devstack sudo[110479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] Creating offline snapshot a1526051-1bdf-4d2a-96c5-846dfb258c02 of volume c29d8c62-5e0f-492e-af6d-1751cf39c21a {{(pid=88880) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb5d7d4-3920-4b46-8e22-4c03b6c3c898]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:30 devstack sudo[110483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a
Aug 04 09:39:30 devstack sudo[110483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:30 devstack sudo[110479]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1" returned: 0 in 0.394s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:30 devstack sudo[110486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1
Aug 04 09:39:30 devstack sudo[110486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:30 devstack sudo[110486]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d.255f53a9-1279-4710-92a4-7d0e7cff36b1" returned: 0 in 0.269s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-255f53a9-1279-4710-92a4-7d0e7cff36b1" released by "_delete_snapshot" :: held 1.582s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:30 devstack sudo[110483]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a" returned: 0 in 0.445s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02 1G {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-a0626786-5938-462e-af6f-ac34a415172d" released by "delete_snapshot" :: held 1.614s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:30 devstack sudo[110492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02 1G
Aug 04 09:39:30 devstack sudo[110492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Created reservations ['c84e9356-20bb-440c-91bc-8ca516de0ad1', '5dfbf8a5-edb8-4836-af7f-e6a9e4c96b1a', '953ab25b-02fa-4127-b02c-2735f6caf43f', '65b61639-fd02-4103-b286-7dd82a014e46'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:30 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Delete snapshot completed successfully.
Aug 04 09:39:30 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-f019c5b2-2646-465c-ac09-3a3d35253bfd tempest-ProjectReaderTests-1609283064 None] Lock "cinder-255f53a9-1279-4710-92a4-7d0e7cff36b1-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:31 devstack sudo[110492]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02 1G" returned: 0 in 0.450s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:31 devstack sudo[110498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02
Aug 04 09:39:31 devstack sudo[110498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-a0626786-5938-462e-af6f-ac34a415172d-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Lock "cinder-a0626786-5938-462e-af6f-ac34a415172d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Acquiring lock "cinder-quobyte-a0626786-5938-462e-af6f-ac34a415172d" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-a0626786-5938-462e-af6f-ac34a415172d" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5248658-fb94-4cb7-bbac-22d69cb907fa]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:31 devstack sudo[110500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d
Aug 04 09:39:31 devstack sudo[110500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:31 devstack sudo[110498]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a -F qcow2 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02" returned: 0 in 0.396s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:31 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02 is being set with open permissions: ugo+rw
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:31 devstack sudo[110505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02
Aug 04 09:39:31 devstack sudo[110505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:31 devstack sudo[110500]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d" returned: 0 in 0.372s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:31 devstack sudo[110510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d
Aug 04 09:39:31 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:31 devstack sudo[110505]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02" returned: 0 in 0.285s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=182,cinder:INSERT=73,cinder:UPDATE=255,cinder:DELETE=21 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=216,cinder:INSERT=67,cinder:UPDATE=253,cinder:DELETE=19 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:39:31 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:31 devstack sudo[110513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.info
Aug 04 09:39:31 devstack sudo[110513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:32 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-a0626786-5938-462e-af6f-ac34a415172d" returned: 0 in 0.247s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Lock "cinder-quobyte-a0626786-5938-462e-af6f-ac34a415172d" released by "delete_volume" :: held 0.705s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Created reservations ['f6656b49-2717-4168-b926-f74adfe1c8bc', '56a2522b-8d58-4438-88cf-16367b1224f1', 'cafb2a65-4543-4fa5-93a2-f95a71da277b', '2dea60c1-e733-4682-abcf-c0ae1854a0f9'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:32 devstack sudo[110513]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.info" returned: 0 in 0.282s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:32 devstack cinder-volume[88880]: WARNING cinder.volume.drivers.remotefs [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.info is being set with open permissions: ugo+rw
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.info {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:32 devstack sudo[110517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.info
Aug 04 09:39:32 devstack sudo[110517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:32 devstack sudo[110519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:39:32 devstack sudo[110519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:32 devstack sudo[110517]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.info" returned: 0 in 0.261s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:32 devstack sudo[110519]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:32 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ac9d3159-6118-4206-8da9-b2aaf6b2ef19 tempest-ProjectMemberTests-2115972071 None] Create snapshot completed successfully
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.294s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:39:32 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Deleted volume successfully.
Aug 04 09:39:32 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-2755b36d-0998-4fdd-a230-11b6a0358acb tempest-ProjectReaderTests-1609283064 None] Lock "cinder-a0626786-5938-462e-af6f-ac34a415172d-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-a1526051-1bdf-4d2a-96c5-846dfb258c02-delete_snapshot" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-a1526051-1bdf-4d2a-96c5-846dfb258c02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-c29d8c62-5e0f-492e-af6d-1751cf39c21a" by "delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-c29d8c62-5e0f-492e-af6d-1751cf39c21a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-a1526051-1bdf-4d2a-96c5-846dfb258c02" by "_delete_snapshot" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:33 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-a1526051-1bdf-4d2a-96c5-846dfb258c02" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Deleting offline snapshot a1526051-1bdf-4d2a-96c5-846dfb258c02 of volume c29d8c62-5e0f-492e-af6d-1751cf39c21a {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 04 09:39:33 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] snapshot_file for this snap is: volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02 {{(pid=88880) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 04 09:39:33 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a340873-4498-4af8-a7a4-b20e8fb9fc99]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:33 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:33 devstack sudo[110524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02
Aug 04 09:39:33 devstack sudo[110524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:34 devstack sudo[110524]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02" returned: 0 in 0.372s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:34 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88880) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 04 09:39:34 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1091050-07d1-4ec9-9d14-8fc131608882]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:34 devstack sudo[110529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a
Aug 04 09:39:34 devstack sudo[110529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:34 devstack sudo[110529]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a" returned: 0 in 0.371s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:34 devstack sudo[110534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02
Aug 04 09:39:34 devstack sudo[110534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:34 devstack sudo[110534]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02" returned: 0 in 0.372s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:34 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:34 devstack sudo[110539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02
Aug 04 09:39:34 devstack sudo[110539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:35 devstack sudo[110539]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a.a1526051-1bdf-4d2a-96c5-846dfb258c02" returned: 0 in 0.269s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-a1526051-1bdf-4d2a-96c5-846dfb258c02" released by "_delete_snapshot" :: held 1.503s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-c29d8c62-5e0f-492e-af6d-1751cf39c21a" released by "delete_snapshot" :: held 1.531s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:35 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Created reservations ['bb33179a-dcdb-4309-afb7-6f42004abddd', '2f53fc45-9858-477c-97a3-35f298fc1d82', '133c5fca-6938-4118-aee5-5da8b1269dbd', '402fb30c-34b7-49fe-bbed-f4db376415bb'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:35 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Delete snapshot completed successfully.
Aug 04 09:39:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-6c59a80f-366c-4f48-ba3a-fd83442feb19 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-a1526051-1bdf-4d2a-96c5-846dfb258c02-delete_snapshot" released by "delete_snapshot" :: held 1.696s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-c29d8c62-5e0f-492e-af6d-1751cf39c21a-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-c29d8c62-5e0f-492e-af6d-1751cf39c21a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "cinder-quobyte-c29d8c62-5e0f-492e-af6d-1751cf39c21a" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:35 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-c29d8c62-5e0f-492e-af6d-1751cf39c21a" acquired by "delete_volume" :: waited 0.023s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:35 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aab7568-4d28-4ead-b4c6-00a1e88f2608]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:35 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:36 devstack sudo[110542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a
Aug 04 09:39:36 devstack sudo[110542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:36 devstack sudo[110542]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a" returned: 0 in 0.448s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:36 devstack sudo[110547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a
Aug 04 09:39:36 devstack sudo[110547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:36 devstack sudo[110547]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-c29d8c62-5e0f-492e-af6d-1751cf39c21a" returned: 0 in 0.276s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:36 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-quobyte-c29d8c62-5e0f-492e-af6d-1751cf39c21a" released by "delete_volume" :: held 0.781s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:36 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Created reservations ['ef88b183-6e32-4cdf-ac82-66a5c9ae9ed1', '742571e1-e1b4-43b6-b5c3-f7c5c52c9991', 'd63b6ee6-4480-41bc-8d0b-aba37149e402', '1119e017-b788-4e05-a1c5-923e94cf714f'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:36 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:36 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:36 devstack sudo[110550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:39:36 devstack sudo[110550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:37 devstack sudo[110550]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:37 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.254s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:37 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:39:37 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Deleted volume successfully.
Aug 04 09:39:37 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dbade8f5-9fe9-48ab-a6e4-e3869a31e808 tempest-ProjectMemberTests-2115972071 None] Lock "cinder-c29d8c62-5e0f-492e-af6d-1751cf39c21a-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:53 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:39:53 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:39:56 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:39:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Flow 'volume_create_manager' (22e45324-07bf-4b72-af10-fd6994404ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd56a9c-56d8-4b2a-8871-110906427f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd56a9c-56d8-4b2a-8871-110906427f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1937841826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b26af76-4724-44fd-9fad-40ea50d502e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157cd2a8f4c640febe1748b06ef092d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:57Z,use_quota=True,user_id='4b0a4bc9d3c949a5a78f6b75c79f5ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befbe18a-473a-4fa1-8d46-412beec39b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:56 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befbe18a-473a-4fa1-8d46-412beec39b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2835cf00-e105-4123-b95d-8d888ae9508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2835cf00-e105-4123-b95d-8d888ae9508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b26af76-4724-44fd-9fad-40ea50d502e8', 'volume_name': 'volume-9b26af76-4724-44fd-9fad-40ea50d502e8', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12367a30-50f1-487e-a64f-2a4436d733b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12367a30-50f1-487e-a64f-2a4436d733b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911c6ee1-cdae-4191-b48c-a4fdb2ec63cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:57 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Volume 9b26af76-4724-44fd-9fad-40ea50d502e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b26af76-4724-44fd-9fad-40ea50d502e8', 'volume_size': 1}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1937841826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b26af76-4724-44fd-9fad-40ea50d502e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157cd2a8f4c640febe1748b06ef092d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:39:57Z,use_quota=True,user_id='4b0a4bc9d3c949a5a78f6b75c79f5ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Creating volume 9b26af76-4724-44fd-9fad-40ea50d502e8 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:39:57 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9b26af76-4724-44fd-9fad-40ea50d502e8 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:57 devstack sudo[110597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9b26af76-4724-44fd-9fad-40ea50d502e8 1073741824
Aug 04 09:39:57 devstack sudo[110597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:57 devstack sudo[110597]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9b26af76-4724-44fd-9fad-40ea50d502e8 1073741824" returned: 0 in 0.491s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9b26af76-4724-44fd-9fad-40ea50d502e8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:57 devstack sudo[110605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9b26af76-4724-44fd-9fad-40ea50d502e8
Aug 04 09:39:57 devstack sudo[110605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:57 devstack sudo[110605]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9b26af76-4724-44fd-9fad-40ea50d502e8" returned: 0 in 0.245s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911c6ee1-cdae-4191-b48c-a4fdb2ec63cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b26af76-4724-44fd-9fad-40ea50d502e8', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3b3678-41f8-4abf-84a6-2a254eedd0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:57 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Volume volume-9b26af76-4724-44fd-9fad-40ea50d502e8 (9b26af76-4724-44fd-9fad-40ea50d502e8): created successfully
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3b3678-41f8-4abf-84a6-2a254eedd0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:57 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Flow 'volume_create_manager' (22e45324-07bf-4b72-af10-fd6994404ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:57 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-55e12cd4-7eb0-418c-9540-3c650bd3c7c3 tempest-ProjectReaderTests-1951381578 None] Created volume successfully.
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Acquiring lock "cinder-9b26af76-4724-44fd-9fad-40ea50d502e8-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Lock "cinder-9b26af76-4724-44fd-9fad-40ea50d502e8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Acquiring lock "cinder-quobyte-9b26af76-4724-44fd-9fad-40ea50d502e8" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Lock "cinder-quobyte-9b26af76-4724-44fd-9fad-40ea50d502e8" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67e5e62-19b9-4c82-aa5f-e14ee066f791]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9b26af76-4724-44fd-9fad-40ea50d502e8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:58 devstack sudo[110608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9b26af76-4724-44fd-9fad-40ea50d502e8
Aug 04 09:39:58 devstack sudo[110608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:58 devstack sudo[110608]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9b26af76-4724-44fd-9fad-40ea50d502e8" returned: 0 in 0.369s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9b26af76-4724-44fd-9fad-40ea50d502e8 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:58 devstack sudo[110613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9b26af76-4724-44fd-9fad-40ea50d502e8
Aug 04 09:39:58 devstack sudo[110613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:58 devstack sudo[110613]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-9b26af76-4724-44fd-9fad-40ea50d502e8" returned: 0 in 0.249s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Lock "cinder-quobyte-9b26af76-4724-44fd-9fad-40ea50d502e8" released by "delete_volume" :: held 0.661s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Created reservations ['57bee421-9c94-465b-b4d9-ccf58c084cfa', '8db9e3c8-50e6-41e0-99fe-af1d628db8e0', '186b23e9-1d4f-4d73-bde6-1ec8a74ffbe3', '9ac608e1-3679-4565-8427-4eb19307ff0b'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:58 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:58 devstack sudo[110616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:39:59 devstack sudo[110616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:39:59 devstack sudo[110616]: pam_unix(sudo:session): session closed for user root
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.264s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:39:59 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Deleted volume successfully.
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-dae7e237-4cd4-4965-87c4-4da2e4286876 tempest-ProjectReaderTests-1951381578 None] Lock "cinder-9b26af76-4724-44fd-9fad-40ea50d502e8-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Flow 'volume_create_manager' (edd2afcd-ffcf-47be-936e-f27a23c1a1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279f167f-cffa-4d29-a15c-b803b82b13f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279f167f-cffa-4d29-a15c-b803b82b13f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498391481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3ba7f1-f620-4a77-ab35-09b747e0f783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157cd2a8f4c640febe1748b06ef092d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:40:00Z,use_quota=True,user_id='4b0a4bc9d3c949a5a78f6b75c79f5ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7717a5dc-3c49-41b0-83b3-82fabb2a82fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7717a5dc-3c49-41b0-83b3-82fabb2a82fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f677aff3-12b3-4d52-b99f-e88744fc164f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f677aff3-12b3-4d52-b99f-e88744fc164f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3ba7f1-f620-4a77-ab35-09b747e0f783', 'volume_name': 'volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2e57ea-b469-479a-ac7c-1d6984d22e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2e57ea-b469-479a-ac7c-1d6984d22e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc011af-d363-4ca8-ab94-2fbe193d3f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:39:59 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Volume ec3ba7f1-f620-4a77-ab35-09b747e0f783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783', 'volume_size': 1}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498391481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3ba7f1-f620-4a77-ab35-09b747e0f783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157cd2a8f4c640febe1748b06ef092d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:40:00Z,use_quota=True,user_id='4b0a4bc9d3c949a5a78f6b75c79f5ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Creating volume ec3ba7f1-f620-4a77-ab35-09b747e0f783 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:39:59 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:39:59 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:39:59 devstack sudo[110619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783 1073741824
Aug 04 09:39:59 devstack sudo[110619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:00 devstack sudo[110619]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783 1073741824" returned: 0 in 0.453s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:00 devstack sudo[110626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783
Aug 04 09:40:00 devstack sudo[110626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:00 devstack sudo[110626]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783" returned: 0 in 0.245s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc011af-d363-4ca8-ab94-2fbe193d3f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9afe50a-8b28-48a8-915d-ea7eb6f372fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:00 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Volume volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783 (ec3ba7f1-f620-4a77-ab35-09b747e0f783): created successfully
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9afe50a-8b28-48a8-915d-ea7eb6f372fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Flow 'volume_create_manager' (edd2afcd-ffcf-47be-936e-f27a23c1a1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:40:00 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-873d15af-af47-4acf-ac98-58b6f0317b75 tempest-ProjectReaderTests-1951381578 None] Created volume successfully.
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Acquiring lock "cinder-ec3ba7f1-f620-4a77-ab35-09b747e0f783-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Lock "cinder-ec3ba7f1-f620-4a77-ab35-09b747e0f783-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Acquiring lock "cinder-quobyte-ec3ba7f1-f620-4a77-ab35-09b747e0f783" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Lock "cinder-quobyte-ec3ba7f1-f620-4a77-ab35-09b747e0f783" acquired by "delete_volume" :: waited 0.017s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ece447-8644-477c-829f-d0089ae9af49]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:40:00 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:01 devstack sudo[110629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783
Aug 04 09:40:01 devstack sudo[110629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:01 devstack sudo[110629]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783" returned: 0 in 0.372s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:01 devstack sudo[110634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783
Aug 04 09:40:01 devstack sudo[110634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:01 devstack sudo[110634]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-ec3ba7f1-f620-4a77-ab35-09b747e0f783" returned: 0 in 0.254s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Lock "cinder-quobyte-ec3ba7f1-f620-4a77-ab35-09b747e0f783" released by "delete_volume" :: held 0.670s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Created reservations ['a0fadabe-8a47-48ae-bb44-c9c56ea76060', 'f31846d1-26f2-4bae-bbed-70cc582f1e71', 'f76cde92-29c6-4869-afc0-e3aee04dfcba', '7bc15a58-7452-4246-9a60-021b08847b06'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:01 devstack sudo[110637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:40:01 devstack sudo[110637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:01 devstack sudo[110637]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.233s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:40:01 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Deleted volume successfully.
Aug 04 09:40:01 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-405fd12f-7cab-44d2-95a3-c1c65f7f1101 tempest-ProjectReaderTests-1951381578 None] Lock "cinder-ec3ba7f1-f620-4a77-ab35-09b747e0f783-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Flow 'volume_create_manager' (ad867acd-5ed0-4ae4-8b4c-7241b896eeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c49e47c-5a8a-4eb6-9776-6e8701a875a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c49e47c-5a8a-4eb6-9776-6e8701a875a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575639583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83c5440-e624-4d2d-abf4-514a9f9c5f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daeabab0e7f941b48287f166ceb1b745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:40:05Z,use_quota=True,user_id='3e462d42e36a4529ab851dc04dcba44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1aced7-a583-4218-9ea0-bcf1a6482069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1aced7-a583-4218-9ea0-bcf1a6482069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4eb5da-37d4-4bf0-b880-e55cb4c71efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4eb5da-37d4-4bf0-b880-e55cb4c71efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83c5440-e624-4d2d-abf4-514a9f9c5f1b', 'volume_name': 'volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7302abc-0b06-47d9-be87-b70d269bc0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7302abc-0b06-47d9-be87-b70d269bc0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13980222-0303-4e60-9529-bf681750a817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:05 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Volume f83c5440-e624-4d2d-abf4-514a9f9c5f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b', 'volume_size': 1}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575639583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83c5440-e624-4d2d-abf4-514a9f9c5f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daeabab0e7f941b48287f166ceb1b745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:40:05Z,use_quota=True,user_id='3e462d42e36a4529ab851dc04dcba44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Creating volume f83c5440-e624-4d2d-abf4-514a9f9c5f1b {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:40:05 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:40:05 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:05 devstack sudo[110641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b 1073741824
Aug 04 09:40:05 devstack sudo[110641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:06 devstack sudo[110641]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b 1073741824" returned: 0 in 0.452s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:06 devstack sudo[110647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b
Aug 04 09:40:06 devstack sudo[110647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:06 devstack sudo[110647]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b" returned: 0 in 0.247s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13980222-0303-4e60-9529-bf681750a817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ca1dc2-cbaf-4265-8428-7a7048355571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:06 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Volume volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b (f83c5440-e624-4d2d-abf4-514a9f9c5f1b): created successfully
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ca1dc2-cbaf-4265-8428-7a7048355571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Flow 'volume_create_manager' (ad867acd-5ed0-4ae4-8b4c-7241b896eeb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:40:06 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ce08513f-6c01-4d52-9c90-7da0c5e8ae95 tempest-ProjectReaderTests-1388192821 None] Created volume successfully.
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "cinder-f83c5440-e624-4d2d-abf4-514a9f9c5f1b-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Lock "cinder-f83c5440-e624-4d2d-abf4-514a9f9c5f1b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "cinder-quobyte-f83c5440-e624-4d2d-abf4-514a9f9c5f1b" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Lock "cinder-quobyte-f83c5440-e624-4d2d-abf4-514a9f9c5f1b" acquired by "delete_volume" :: waited 0.015s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f9184d-6e0e-41a2-b9b1-03e36563945a]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:40:06 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:06 devstack sudo[110650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b
Aug 04 09:40:06 devstack sudo[110650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:07 devstack sudo[110650]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b" returned: 0 in 0.354s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:07 devstack sudo[110655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b
Aug 04 09:40:07 devstack sudo[110655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:07 devstack sudo[110655]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-f83c5440-e624-4d2d-abf4-514a9f9c5f1b" returned: 0 in 0.242s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Lock "cinder-quobyte-f83c5440-e624-4d2d-abf4-514a9f9c5f1b" released by "delete_volume" :: held 0.634s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Created reservations ['77a2da7b-573e-4869-8998-897d97961a11', '055556fe-fbce-47d6-bcea-2df993ad266f', '21bf3287-618a-4b06-97ad-5c1dac784b1d', '92379df7-6166-4db5-9e9b-8d3fb4fd9ce0'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:07 devstack sudo[110658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:40:07 devstack sudo[110658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:07 devstack sudo[110658]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.242s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:40:07 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Deleted volume successfully.
Aug 04 09:40:07 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-ba6abed5-c309-4428-8682-e0f0f4001501 tempest-ProjectReaderTests-1388192821 None] Lock "cinder-f83c5440-e624-4d2d-abf4-514a9f9c5f1b-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:08 devstack sudo[110661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:40:08 devstack sudo[110661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Flow 'volume_create_manager' (f8ecc0eb-7c35-4a2b-930b-91bb176f4ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198368a5-726a-49df-890f-cdb6de85f786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198368a5-726a-49df-890f-cdb6de85f786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341031174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0842bd-c809-4040-bdf2-750726486d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daeabab0e7f941b48287f166ceb1b745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:40:08Z,use_quota=True,user_id='3e462d42e36a4529ab851dc04dcba44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fb83d9-3909-4ecb-9c62-589926024918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fb83d9-3909-4ecb-9c62-589926024918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee2d53f-d0df-4c26-8fbb-e114ac48a18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee2d53f-d0df-4c26-8fbb-e114ac48a18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b0842bd-c809-4040-bdf2-750726486d8c', 'volume_name': 'volume-0b0842bd-c809-4040-bdf2-750726486d8c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a126e70c-8d01-4efb-84ed-45b0f5d33fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a126e70c-8d01-4efb-84ed-45b0f5d33fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:08 devstack sudo[110661]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b970fa7-5bd2-4b4b-b9cb-8e2ce0b76145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:08 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Volume 0b0842bd-c809-4040-bdf2-750726486d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b0842bd-c809-4040-bdf2-750726486d8c', 'volume_size': 1}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341031174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0842bd-c809-4040-bdf2-750726486d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daeabab0e7f941b48287f166ceb1b745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:40:08Z,use_quota=True,user_id='3e462d42e36a4529ab851dc04dcba44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Creating volume 0b0842bd-c809-4040-bdf2-750726486d8c {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:40:08 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b0842bd-c809-4040-bdf2-750726486d8c 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.314s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_service.periodic_task [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] Running periodic task VolumeManager._thread_info {{(pid=88880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread count: 28 {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-019728fb-597f-4d06-9c4f-44bbd91918e6 None None] thread info: [<_MainThread(MainThread, started 140040650137728)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140040548735552)>, <Thread(Thread-3 (stat_writer), started daemon 140040538813376)>, <Thread(Rabbit-heartbeat, started daemon 140040539373760)>, <Thread(Thread-5 (_runner), started daemon 140040536593920)>, <Thread(Thread-7 (_runner), started daemon 140040536676864)>, <Thread(fd_logger, started daemon 140040534655872)>, <Thread(privsep_reader, started daemon 140040536289856)>, <Thread(tpool_thread_0, started daemon 140040528053952)>, <Thread(tpool_thread_1, started daemon 140040519661248)>, <Thread(tpool_thread_2, started daemon 140040511268544)>, <Thread(tpool_thread_3, started daemon 140040502875840)>, <Thread(tpool_thread_4, started daemon 140040494483136)>, <Thread(tpool_thread_5, started daemon 140040486074048)>, <Thread(tpool_thread_6, started daemon 140040477664960)>, <Thread(tpool_thread_7, started daemon 140040469255872)>, <Thread(tpool_thread_8, started daemon 140040460846784)>, <Thread(tpool_thread_9, started daemon 140040452437696)>, <Thread(tpool_thread_10, started daemon 140040444028608)>, <Thread(tpool_thread_11, started daemon 140040435619520)>, <Thread(tpool_thread_12, started daemon 140040427210432)>, <Thread(tpool_thread_13, started daemon 140040418801344)>, <Thread(tpool_thread_14, started daemon 140040410392256)>, <Thread(tpool_thread_15, started daemon 140040401983168)>, <Thread(tpool_thread_16, started daemon 140040393574080)>, <Thread(tpool_thread_17, started daemon 140040385164992)>, <Thread(tpool_thread_18, started daemon 140040376755904)>, <Thread(tpool_thread_19, started daemon 140040368346816)>] {{(pid=88880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 04 09:40:08 devstack sudo[110664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b0842bd-c809-4040-bdf2-750726486d8c 1073741824
Aug 04 09:40:08 devstack sudo[110664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:08 devstack sudo[110664]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b0842bd-c809-4040-bdf2-750726486d8c 1073741824" returned: 0 in 0.440s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:08 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b0842bd-c809-4040-bdf2-750726486d8c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:08 devstack sudo[110670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b0842bd-c809-4040-bdf2-750726486d8c
Aug 04 09:40:08 devstack sudo[110670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:09 devstack sudo[110670]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b0842bd-c809-4040-bdf2-750726486d8c" returned: 0 in 0.261s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b970fa7-5bd2-4b4b-b9cb-8e2ce0b76145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0842bd-c809-4040-bdf2-750726486d8c', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7267d9b1-4d63-47be-9dcf-e694f93829b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:09 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Volume volume-0b0842bd-c809-4040-bdf2-750726486d8c (0b0842bd-c809-4040-bdf2-750726486d8c): created successfully
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7267d9b1-4d63-47be-9dcf-e694f93829b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Flow 'volume_create_manager' (f8ecc0eb-7c35-4a2b-930b-91bb176f4ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:40:09 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-f466f612-c07e-469a-aa9b-f6362ed55d45 tempest-ProjectReaderTests-1388192821 None] Created volume successfully.
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Acquiring lock "cinder-0b0842bd-c809-4040-bdf2-750726486d8c-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Lock "cinder-0b0842bd-c809-4040-bdf2-750726486d8c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Acquiring lock "cinder-quobyte-0b0842bd-c809-4040-bdf2-750726486d8c" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Lock "cinder-quobyte-0b0842bd-c809-4040-bdf2-750726486d8c" acquired by "delete_volume" :: waited 0.016s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa226bc-0f87-47b0-9114-2ebb1d03f290]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b0842bd-c809-4040-bdf2-750726486d8c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:09 devstack sudo[110673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b0842bd-c809-4040-bdf2-750726486d8c
Aug 04 09:40:09 devstack sudo[110673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:09 devstack sudo[110673]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b0842bd-c809-4040-bdf2-750726486d8c" returned: 0 in 0.372s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:09 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b0842bd-c809-4040-bdf2-750726486d8c {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:09 devstack sudo[110678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b0842bd-c809-4040-bdf2-750726486d8c
Aug 04 09:40:09 devstack sudo[110678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:10 devstack sudo[110678]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-0b0842bd-c809-4040-bdf2-750726486d8c" returned: 0 in 0.276s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Lock "cinder-quobyte-0b0842bd-c809-4040-bdf2-750726486d8c" released by "delete_volume" :: held 0.689s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:40:10 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Created reservations ['3bce3e22-b4cf-4fdb-b9a9-e5864b184b67', '1efb8bfc-6148-419f-af7b-bb0ac7d35905', 'cc0ab7ea-be4e-49d6-a213-74bb21ac8667', '0eeeb349-db69-4576-80f9-4a9510db9ca4'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:40:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:40:10 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:40:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:10 devstack sudo[110682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:40:10 devstack sudo[110682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:10 devstack sudo[110682]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:10 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.272s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:10 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:40:10 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Deleted volume successfully.
Aug 04 09:40:10 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-711fd01d-66fc-4658-9a83-e34cd74ba78a tempest-ProjectReaderTests-1388192821 None] Lock "cinder-0b0842bd-c809-4040-bdf2-750726486d8c-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Flow 'volume_create_manager' (075d92f6-a3ee-48cd-a36e-74153845495a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e3f478-81e4-43e8-81be-f5776ce313de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e3f478-81e4-43e8-81be-f5776ce313de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888715166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ba1079-dbe4-4840-b8a0-404c654f7348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daeabab0e7f941b48287f166ceb1b745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:40:11Z,use_quota=True,user_id='3e462d42e36a4529ab851dc04dcba44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf360261-be57-4dae-b587-fd008231338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf360261-be57-4dae-b587-fd008231338e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cf9dfc-8e66-44af-a8b7-54ab1c63877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cf9dfc-8e66-44af-a8b7-54ab1c63877d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ba1079-dbe4-4840-b8a0-404c654f7348', 'volume_name': 'volume-15ba1079-dbe4-4840-b8a0-404c654f7348', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee66db0f-189e-4633-b498-4fa9af5a9ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee66db0f-189e-4633-b498-4fa9af5a9ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656d6305-27a6-43cb-be30-2fd28126f2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:11 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Volume 15ba1079-dbe4-4840-b8a0-404c654f7348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ba1079-dbe4-4840-b8a0-404c654f7348', 'volume_size': 1}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888715166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ba1079-dbe4-4840-b8a0-404c654f7348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daeabab0e7f941b48287f166ceb1b745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:40:11Z,use_quota=True,user_id='3e462d42e36a4529ab851dc04dcba44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Creating volume 15ba1079-dbe4-4840-b8a0-404c654f7348 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:40:11 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-15ba1079-dbe4-4840-b8a0-404c654f7348 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:11 devstack sudo[110685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-15ba1079-dbe4-4840-b8a0-404c654f7348 1073741824
Aug 04 09:40:11 devstack sudo[110685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:11 devstack sudo[110685]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-15ba1079-dbe4-4840-b8a0-404c654f7348 1073741824" returned: 0 in 0.455s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-15ba1079-dbe4-4840-b8a0-404c654f7348 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:11 devstack sudo[110691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-15ba1079-dbe4-4840-b8a0-404c654f7348
Aug 04 09:40:11 devstack sudo[110691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:11 devstack sudo[110691]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-15ba1079-dbe4-4840-b8a0-404c654f7348" returned: 0 in 0.253s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656d6305-27a6-43cb-be30-2fd28126f2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ba1079-dbe4-4840-b8a0-404c654f7348', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c8c0d2-750d-4473-9b0e-58a965f82505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:11 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Volume volume-15ba1079-dbe4-4840-b8a0-404c654f7348 (15ba1079-dbe4-4840-b8a0-404c654f7348): created successfully
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c8c0d2-750d-4473-9b0e-58a965f82505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:11 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Flow 'volume_create_manager' (075d92f6-a3ee-48cd-a36e-74153845495a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:40:11 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-92afa6de-615d-43eb-8dbc-b7b679176c68 tempest-ProjectReaderTests-1388192821 None] Created volume successfully.
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "cinder-15ba1079-dbe4-4840-b8a0-404c654f7348-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Lock "cinder-15ba1079-dbe4-4840-b8a0-404c654f7348-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "cinder-quobyte-15ba1079-dbe4-4840-b8a0-404c654f7348" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Lock "cinder-quobyte-15ba1079-dbe4-4840-b8a0-404c654f7348" acquired by "delete_volume" :: waited 0.013s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4f9195-d3da-4cb3-97e5-a7ed6f7d2f4f]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-15ba1079-dbe4-4840-b8a0-404c654f7348 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:12 devstack sudo[110694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-15ba1079-dbe4-4840-b8a0-404c654f7348
Aug 04 09:40:12 devstack sudo[110694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:12 devstack sudo[110694]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-15ba1079-dbe4-4840-b8a0-404c654f7348" returned: 0 in 0.360s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-15ba1079-dbe4-4840-b8a0-404c654f7348 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:12 devstack sudo[110699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-15ba1079-dbe4-4840-b8a0-404c654f7348
Aug 04 09:40:12 devstack sudo[110699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:12 devstack sudo[110699]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-15ba1079-dbe4-4840-b8a0-404c654f7348" returned: 0 in 0.245s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Lock "cinder-quobyte-15ba1079-dbe4-4840-b8a0-404c654f7348" released by "delete_volume" :: held 0.658s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Created reservations ['09028c34-142e-477e-99cb-40971aa323c4', '4962d1e6-7d79-4cb8-9a38-c21ab5994a62', 'aab01136-89a6-4079-818a-7bd960415b7f', '89bc69c0-45b6-412e-bf7e-22b0b766cc67'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:12 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:12 devstack sudo[110702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:40:12 devstack sudo[110702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:13 devstack sudo[110702]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.247s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:40:13 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Deleted volume successfully.
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-440a4d4d-b7d9-45f3-b86c-e6ae7239aad7 tempest-ProjectReaderTests-1388192821 None] Lock "cinder-15ba1079-dbe4-4840-b8a0-404c654f7348-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88880) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Flow 'volume_create_manager' (c6770550-6cb1-4382-8ba2-ae2343285435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0d778d-eaf3-4d9e-ab52-514739ec6a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0d778d-eaf3-4d9e-ab52-514739ec6a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1652648071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924b2aa6-6da4-441f-850e-b339ffe3ef50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daeabab0e7f941b48287f166ceb1b745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:40:14Z,use_quota=True,user_id='3e462d42e36a4529ab851dc04dcba44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e4ed61-4826-4508-b6f6-2b96c944b8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e4ed61-4826-4508-b6f6-2b96c944b8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e670f8e3-0284-46e0-913f-d4ed7af65d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e670f8e3-0284-46e0-913f-d4ed7af65d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924b2aa6-6da4-441f-850e-b339ffe3ef50', 'volume_name': 'volume-924b2aa6-6da4-441f-850e-b339ffe3ef50', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01360d9d-0b4c-475d-aeae-b37ed5a4e8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01360d9d-0b4c-475d-aeae-b37ed5a4e8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f24ff6-1c00-481e-883e-477d75c59f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:13 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Volume 924b2aa6-6da4-441f-850e-b339ffe3ef50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924b2aa6-6da4-441f-850e-b339ffe3ef50', 'volume_size': 1}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5dba91ac30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-04T07:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1652648071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924b2aa6-6da4-441f-850e-b339ffe3ef50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daeabab0e7f941b48287f166ceb1b745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-04T07:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-04T07:40:14Z,use_quota=True,user_id='3e462d42e36a4529ab851dc04dcba44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb331a02-ed5e-4bf6-b10c-f4c605ba83e9),volume_type_id=cb331a02-ed5e-4bf6-b10c-f4c605ba83e9)}" {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.remotefs [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Creating volume 924b2aa6-6da4-441f-850e-b339ffe3ef50 {{(pid=88880) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Selected osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35 as target Quobyte volume. {{(pid=88880) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Aug 04 09:40:13 devstack cinder-volume[88880]: INFO cinder.volume.drivers.remotefs [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] casted to osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35
Aug 04 09:40:13 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-924b2aa6-6da4-441f-850e-b339ffe3ef50 1073741824 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:13 devstack sudo[110705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-924b2aa6-6da4-441f-850e-b339ffe3ef50 1073741824
Aug 04 09:40:13 devstack sudo[110705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:14 devstack sudo[110705]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-924b2aa6-6da4-441f-850e-b339ffe3ef50 1073741824" returned: 0 in 0.446s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-924b2aa6-6da4-441f-850e-b339ffe3ef50 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:14 devstack sudo[110710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-924b2aa6-6da4-441f-850e-b339ffe3ef50
Aug 04 09:40:14 devstack sudo[110710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:14 devstack sudo[110710]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-924b2aa6-6da4-441f-850e-b339ffe3ef50" returned: 0 in 0.264s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'} {{(pid=88880) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f24ff6-1c00-481e-883e-477d75c59f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924b2aa6-6da4-441f-850e-b339ffe3ef50', 'volume_size': 1}' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076e8ecf-162a-4667-861f-5f36be382e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 04 09:40:14 devstack cinder-volume[88880]: INFO cinder.volume.flows.manager.create_volume [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Volume volume-924b2aa6-6da4-441f-850e-b339ffe3ef50 (924b2aa6-6da4-441f-850e-b339ffe3ef50): created successfully
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076e8ecf-162a-4667-861f-5f36be382e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88880) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Flow 'volume_create_manager' (c6770550-6cb1-4382-8ba2-ae2343285435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88880) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 04 09:40:14 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-e70db4b9-3dec-4bf0-8682-0fa2895d52c9 tempest-ProjectReaderTests-1388192821 None] Created volume successfully.
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Acquiring lock "cinder-924b2aa6-6da4-441f-850e-b339ffe3ef50-delete_volume" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Lock "cinder-924b2aa6-6da4-441f-850e-b339ffe3ef50-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Acquiring lock "cinder-quobyte-924b2aa6-6da4-441f-850e-b339ffe3ef50" by "delete_volume" {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Lock "cinder-quobyte-924b2aa6-6da4-441f-850e-b339ffe3ef50" acquired by "delete_volume" :: waited 0.014s {{(pid=88880) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ac7e51-1449-4ea7-bc1f-e58cdd2cbc07]: (4, 'qcow2') {{(pid=89678) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 04 09:40:14 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-924b2aa6-6da4-441f-850e-b339ffe3ef50 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:15 devstack sudo[110713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-924b2aa6-6da4-441f-850e-b339ffe3ef50
Aug 04 09:40:15 devstack sudo[110713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:15 devstack sudo[110713]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-924b2aa6-6da4-441f-850e-b339ffe3ef50" returned: 0 in 0.381s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-924b2aa6-6da4-441f-850e-b339ffe3ef50 {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:15 devstack sudo[110718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-924b2aa6-6da4-441f-850e-b339ffe3ef50
Aug 04 09:40:15 devstack sudo[110718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:15 devstack sudo[110718]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f/volume-924b2aa6-6da4-441f-850e-b339ffe3ef50" returned: 0 in 0.260s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Lock "cinder-quobyte-924b2aa6-6da4-441f-850e-b339ffe3ef50" released by "delete_volume" :: held 0.683s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG cinder.quota [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Created reservations ['48ba69a9-ecd6-4a71-b84b-836ac0bcdf7e', 'e2d5c683-3c89-4362-98f4-edd68e05da28', '7804f7ff-19cc-4d06-859b-5596055520b7', '485097e2-d788-4bd7-a61f-84a3fc7fa5a9'] {{(pid=88880) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35': None} {{(pid=88880) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG cinder.volume.drivers.quobyte [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eae2c6ee-1518-4d54-abcc-30addca07e35'] {{(pid=88880) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.lockutils [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88880) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 04 09:40:15 devstack sudo[110721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f
Aug 04 09:40:15 devstack sudo[110721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 04 09:40:15 devstack sudo[110721]: pam_unix(sudo:session): session closed for user root
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG oslo_concurrency.processutils [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca498416db89c64446b6196ad8b2150f" returned: 0 in 0.266s {{(pid=88880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG cinder.manager [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Notifying Schedulers of capabilities ... {{(pid=88880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 04 09:40:15 devstack cinder-volume[88880]: INFO cinder.volume.manager [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Deleted volume successfully.
Aug 04 09:40:15 devstack cinder-volume[88880]: DEBUG cinder.coordination [None req-544baaa0-9d61-4407-a78e-0124fd20d1bd tempest-ProjectReaderTests-1388192821 None] Lock "cinder-924b2aa6-6da4-441f-850e-b339ffe3ef50-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88880) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 04 09:40:25 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:UPDATE=64,cinder:SELECT=40,cinder:INSERT=13,cinder:DELETE=6 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 04 09:40:25 devstack cinder-volume[88880]: DEBUG dbcounter [-] [88880] Writing DB stats cinder:SELECT=44,cinder:UPDATE=68,cinder:INSERT=17,cinder:DELETE=6 {{(pid=88880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}